-- Logs begin at Thu 2022-09-01 04:39:43 UTC, end at Thu 2022-09-01 06:03:02 UTC. -- Sep 01 05:22:05.359725 dv-cinder-852208-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:22:05.368540 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:22:05 2022] *** Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: nodename: dv-cinder-852208-15-iscsi Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: machine: x86_64 Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: clock source: unix Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: pcre jit disabled Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: detected number of CPU cores: 4 Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: current working directory: / Sep 01 05:22:05.370570 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: your processes number limit is 47680 Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: your memory page size is 4096 bytes Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: detected max file descriptor number: 2048 Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: lock engine: pthread robust mutexes Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: thunder lock: enabled Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:22:05.371294 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:22:05.410608 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: Python main interpreter initialized at 0x564f710879c0 Sep 01 05:22:05.410608 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: python threads support enabled Sep 01 05:22:05.410608 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: your server socket listen backlog is limited to 100 connections Sep 01 05:22:05.410608 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:22:05.410941 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:22:05.411019 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: *** Operational MODE: preforking *** Sep 01 05:22:05.411272 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:22:05.411272 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: spawned uWSGI master process (pid: 105839) Sep 01 05:22:05.411461 dv-cinder-852208-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:22:05.412146 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: spawned uWSGI worker 1 (pid: 105840, cores: 1) Sep 01 05:22:05.412340 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: spawned uWSGI worker 2 (pid: 105841, cores: 1) Sep 01 05:22:05.412505 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:22:06.078707 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:22:06.081017 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:22:07.178214 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:22:07.178214 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: from cryptography.utils import int_from_bytes Sep 01 05:22:07.179493 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:22:07.179493 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: from cryptography.utils import int_from_bytes Sep 01 05:22:07.181884 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:22:07.181884 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: from cryptography.utils import int_from_bytes Sep 01 05:22:07.182329 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:22:07.182329 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: from cryptography.utils import int_from_bytes Sep 01 05:22:09.723269 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:22:09.723961 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:22:09.724049 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:22:09.724350 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:22:09.724719 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:22:09.725114 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.725441 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.726499 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.726778 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.727119 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.727430 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.727752 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.728074 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.728739 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.728834 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.729117 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.729449 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-15-iscsi {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.729797 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.730113 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.730425 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.730743 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.731048 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.731371 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.731679 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.732169 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.732605 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.732914 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.733226 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.733604 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.733926 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.734241 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.734565 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.734879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.735205 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.735516 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.735920 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-15-iscsi {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.736241 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.736557 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.736641 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:22:09.737010 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:22:09.737101 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.737276 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.737370 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:22:09.737615 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.737718 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:22:09.737929 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738030 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:22:09.738251 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738363 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738579 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738680 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738889 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.738980 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739219 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739305 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739539 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739628 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739858 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.739998 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740158 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740254 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740559 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740781 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.740881 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.741036 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.741131 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742006 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742221 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742495 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-15-iscsi {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742643 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742741 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742829 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.742915 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743029 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743210 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743347 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743530 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743663 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743838 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.743989 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744161 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744318 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744467 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744564 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744815 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.744973 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745138 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745286 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745475 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745614 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745801 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.745923 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746115 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746258 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746425 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746571 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746735 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.746878 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747043 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747194 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747353 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747498 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747661 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747817 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.747969 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748123 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748289 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748515 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-15-iscsi {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748656 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748826 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.748925 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749133 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749228 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749440 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749558 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749865 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.749963 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750175 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750271 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750482 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750578 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750798 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.750886 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751117 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751204 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751424 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751509 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751743 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.751834 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752060 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752157 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752365 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752463 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752675 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752768 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.752970 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753061 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753275 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753603 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753704 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.753924 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754024 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754176 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754273 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754479 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754566 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754746 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.754830 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755050 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755152 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755368 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755454 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755674 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755758 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.755984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756086 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756230 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756314 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756478 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756566 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756793 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.756922 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.757176 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.757385 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.757663 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.757798 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.757901 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758102 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758191 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758405 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758710 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.758804 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759013 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759111 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759317 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759451 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759620 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759709 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.759935 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760028 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760245 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760340 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760550 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760646 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760854 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.760946 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761158 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761251 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761497 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761589 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761809 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.761895 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762111 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762202 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762433 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762521 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.762828 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763049 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763143 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763369 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763457 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763676 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763770 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.763982 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764077 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764283 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764376 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764584 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764676 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764888 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.764993 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765205 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765293 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765532 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765631 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765785 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.765881 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766083 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766180 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766384 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766477 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766697 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766796 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.766998 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767089 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767300 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767392 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767599 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767768 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767896 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.767984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768196 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768289 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768497 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768591 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768795 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.768895 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769095 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769187 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769397 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769548 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769720 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.769806 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.770021 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.770107 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.770322 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.770431 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.770622 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.770714 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.770932 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.771027 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.771245 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.771332 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.771546 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.771633 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.771846 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.771944 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.772146 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.772239 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.772445 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.772579 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.772923 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.773104 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.773263 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.773393 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.773533 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.773736 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.773842 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.774052 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.774143 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.774372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.774464 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.774692 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.774778 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.775044 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.775139 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.775321 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.775412 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.775637 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.775722 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.775938 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.776033 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.776241 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.776326 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.776553 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.776651 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.776856 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.776941 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.777158 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.777254 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.777496 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.777600 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.777780 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.777873 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.778081 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.778167 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.778383 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.778481 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.778682 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.778768 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.778980 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.779065 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.779276 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.779372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.779586 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.779672 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.779901 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.779988 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.780205 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.780312 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.780509 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.780601 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.780810 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.780897 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.781123 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:22:09.781218 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.781472 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.781574 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.781798 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.781886 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782116 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782213 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782431 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782517 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782744 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.782837 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783057 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783145 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783368 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783455 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783679 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783793 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.783990 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784116 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784310 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784442 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784617 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784760 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.784924 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785073 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785230 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785391 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785566 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785731 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.785881 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786044 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786205 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786355 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786518 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786662 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786830 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.786971 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787142 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787277 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787449 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787586 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787760 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.787891 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.788081 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.788803 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.788956 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.789186 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.789362 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.789519 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.789656 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.789842 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790002 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790170 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790315 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790449 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790639 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790760 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.790956 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791075 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791264 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791383 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791573 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791696 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.791881 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792006 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792199 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792313 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792525 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792637 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792835 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.792948 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793150 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793237 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793507 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793600 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793828 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.793917 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794140 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794227 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794449 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794544 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794757 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.794843 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795066 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795152 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795371 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795471 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795680 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.795767 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796000 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796085 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796311 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796407 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796620 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796712 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.796928 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797022 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797241 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797340 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797573 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797663 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797882 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.797976 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798188 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798276 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798490 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798578 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798793 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.798880 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799095 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799183 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799413 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799504 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799696 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799780 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.799995 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800085 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800307 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800401 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800609 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800693 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.800917 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801002 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801222 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801309 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801549 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801652 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801855 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.801948 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802178 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802273 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802488 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802584 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802791 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.802883 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.803090 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.803180 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.803393 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.803491 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.803710 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.804437 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.804604 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.804746 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.804950 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805101 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805268 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805361 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805602 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805693 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.805912 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806001 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806225 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806311 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806536 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806624 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806845 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.806944 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807151 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807245 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807460 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807550 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807773 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.807867 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808080 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808173 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808387 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808481 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808702 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.808795 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809012 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809106 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809315 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809408 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809660 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809756 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.809978 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810062 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810285 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810380 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810585 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810671 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810891 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.810979 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811192 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811290 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811492 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811579 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811792 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.811878 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812097 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812192 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812444 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812530 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812751 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.812837 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813048 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813142 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813349 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813436 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813680 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813768 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.813998 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814084 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814300 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814391 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814600 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814686 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814900 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.814993 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815200 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815296 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815514 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815599 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815832 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.815918 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816135 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816221 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816449 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816543 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816777 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.816864 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817093 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817179 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817403 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817550 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.817834 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818049 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818141 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818357 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818456 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818665 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818750 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.818973 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819072 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819281 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819497 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819688 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819842 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.819992 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.820143 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.820227 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.820319 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.820758 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.820897 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821075 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821170 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821382 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821490 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821715 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.821812 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822021 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822106 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822331 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822427 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822638 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822731 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.822949 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823043 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823265 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823351 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823573 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823658 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823880 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.823972 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824186 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824274 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824492 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824579 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824796 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.824880 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825098 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825184 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825411 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825553 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825740 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.825840 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826043 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826136 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826349 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826472 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826669 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826784 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.826976 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827076 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827279 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827378 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827577 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827689 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827886 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.827993 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828197 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828295 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828510 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828621 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828817 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.828921 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829124 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829221 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829438 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829564 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829767 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.829872 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830075 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830172 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830378 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830472 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830682 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830770 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.830983 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831290 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831377 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831601 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831698 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831909 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.831997 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832214 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832303 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832515 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832602 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832816 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.832909 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.833120 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.833205 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.833428 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.833538 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.833754 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834024 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834112 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834359 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834446 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834663 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834749 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.834993 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835080 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835333 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835491 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835630 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835724 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.835933 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836033 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836251 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836339 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836646 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836861 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.836957 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837163 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837250 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837485 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837591 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837802 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.837911 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838115 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838203 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838413 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838504 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838713 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.838806 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839016 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839103 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839320 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839404 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839622 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839708 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.839926 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840011 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840226 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840360 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840533 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840622 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840840 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.840925 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841143 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841228 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841596 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841773 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.841859 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842076 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842179 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842385 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842473 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842685 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842770 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.842988 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843083 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843290 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843377 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843601 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843687 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.843902 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844000 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844208 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844295 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844520 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844605 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.844885 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845079 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845193 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845539 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845746 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.845910 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846063 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846150 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846381 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846476 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846706 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.846804 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847016 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847111 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847324 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847423 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847626 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847719 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.847935 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848032 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848238 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848332 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848538 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848625 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848842 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.848930 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849140 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849225 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849440 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849557 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849763 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.849853 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.850066 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.850153 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.850374 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.850468 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.851593 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.851593 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.851868 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.851955 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852034 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852123 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852205 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852370 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852459 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852673 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852759 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.852981 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853069 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853283 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853370 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853642 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853758 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.853951 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854066 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854251 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854676 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854852 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.854986 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855189 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855297 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855492 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855588 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855826 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.855913 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856152 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856238 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856490 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856590 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856794 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.856881 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857097 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857191 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857418 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857542 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857744 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.857832 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858049 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858147 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858348 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858436 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858654 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.858958 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859044 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859259 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859346 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859564 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859658 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859871 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.859957 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860175 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860261 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860475 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860560 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860774 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.860859 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861077 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861162 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861374 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861479 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861709 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.861809 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862014 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862109 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862315 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862403 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862613 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862707 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.862920 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863015 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863222 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863307 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863524 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863622 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863829 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.863917 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864127 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864216 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864439 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864538 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864742 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.864836 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865041 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865129 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865340 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865435 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865671 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865759 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.865976 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.866062 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.866319 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.866960 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867133 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867292 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867436 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867640 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867738 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.867961 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868064 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868283 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868382 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868590 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868686 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868885 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.868972 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869189 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869284 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869531 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869623 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869846 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.869931 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870145 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870273 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870452 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870580 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870754 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.870846 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871055 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871143 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871355 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871660 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871756 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.871960 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872047 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872260 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872354 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872559 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872645 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.872859 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873019 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873177 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873263 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873514 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873605 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873831 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.873927 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874129 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874222 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874430 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874523 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874731 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.874831 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875038 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875160 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875346 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875439 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875673 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875769 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.875985 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876070 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876289 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876373 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876603 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876736 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876909 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.876995 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877221 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877313 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877551 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877655 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877854 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.877981 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878167 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878302 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878479 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878613 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878787 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.878919 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879089 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879231 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879391 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879543 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879710 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.879861 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880020 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880177 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880327 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880485 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880644 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.880909 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881000 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881223 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881311 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881560 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881649 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.881897 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882048 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882292 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882388 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882503 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882791 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.882891 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883099 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883197 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883415 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883510 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883718 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.883804 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884027 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884122 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884333 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884419 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884640 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884726 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.884947 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885035 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885252 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885438 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885583 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885783 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.885887 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886093 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886189 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886489 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886576 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886795 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.886898 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887098 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887406 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887493 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887708 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.887803 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888018 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888105 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888322 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888423 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888642 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888740 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.888954 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889041 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889280 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889368 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889631 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889722 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.889940 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890026 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890249 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890336 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890557 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890644 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890865 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.890957 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891167 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891261 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891494 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891580 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891819 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.891917 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892168 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892263 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892478 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892565 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892784 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.892879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893086 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893179 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893398 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893515 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893744 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.893832 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894050 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894137 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894355 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894454 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894656 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894750 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.894959 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895045 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895263 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895358 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895577 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895663 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895894 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.895980 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896208 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896303 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896521 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896611 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896828 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.896962 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897134 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897271 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897488 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897625 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897797 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.897977 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.898122 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.898416 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.898504 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.898741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.898850 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899056 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899151 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899361 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899463 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899671 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899768 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.899982 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900077 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900289 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900376 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900594 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900688 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900897 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.900984 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901237 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901324 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901566 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901669 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901891 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.901979 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902203 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902288 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902525 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902613 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902836 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.902923 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903170 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903258 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903494 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903594 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903816 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.903912 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904224 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904444 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904538 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904748 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.904835 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905050 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905135 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905350 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905443 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905678 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905782 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.905981 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906068 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906288 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906385 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906596 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906691 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906897 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.906989 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907202 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907301 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907503 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907595 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907807 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.907894 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908115 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908202 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908416 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908504 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908747 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.908884 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909041 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909127 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909347 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909433 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909676 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909767 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.909979 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910066 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910300 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910387 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910609 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910748 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.910912 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911007 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911216 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911304 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911520 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911615 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911834 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.911919 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912148 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912241 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912459 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912778 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.912864 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.913092 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.913738 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.913956 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914130 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914272 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914361 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914563 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914651 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914878 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.914979 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.915197 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.915286 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.915556 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.915716 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.915860 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916048 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916163 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916365 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916473 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916680 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916780 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.916994 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917085 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917312 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917399 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917654 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917758 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.917954 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918047 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918257 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918351 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918559 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918655 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.918867 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919017 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919166 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919252 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919484 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919569 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919791 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.919878 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920093 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920187 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920396 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920486 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920697 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.920849 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921033 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921170 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921337 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921424 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921684 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921781 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.921991 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922087 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922311 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922402 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922622 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922708 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.922930 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923025 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923242 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923330 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923552 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923637 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923862 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.923949 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924174 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924268 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924481 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924568 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924788 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.924884 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925096 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925181 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925403 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925524 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925739 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.925835 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926060 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926252 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926397 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926576 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926719 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.926887 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927034 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927197 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927350 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927507 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927669 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.927802 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928110 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928210 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928417 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928517 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928803 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.928926 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929125 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929281 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929437 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929578 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929844 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.929938 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930166 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930255 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930495 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930583 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930806 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.930942 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931123 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931222 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931434 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931529 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931742 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.931835 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932047 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932135 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932371 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932458 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932684 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932779 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.932987 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933082 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933301 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933389 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933634 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933722 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.933945 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934168 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934257 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934513 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934601 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934832 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.934927 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935144 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935232 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935454 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935541 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935763 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.935859 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936069 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936155 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936377 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936463 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936687 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936781 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.936997 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937085 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937315 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937402 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937649 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937784 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.937956 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938042 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938262 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938351 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938575 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938770 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.938885 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939082 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939216 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939411 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939508 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939736 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.939824 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940057 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940151 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940370 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940466 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940672 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940759 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.940983 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941283 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941415 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941610 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941709 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.941917 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942010 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942219 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942306 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942519 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942604 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942825 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.942911 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943129 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943216 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943428 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943515 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943730 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.943815 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.944037 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.944123 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.944340 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.945104 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.945266 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.945438 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.945957 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946055 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946289 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946377 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946602 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946698 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946912 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.946999 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947230 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947317 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947544 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947642 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947847 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.947932 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948151 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948238 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948465 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948560 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948773 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.948860 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949077 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949171 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949379 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949657 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949759 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.949996 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950092 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950300 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950395 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950607 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950695 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950909 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.950996 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951232 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951335 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951534 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951622 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951836 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.951924 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952137 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952235 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952444 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952531 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952744 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.952831 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953045 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953141 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953349 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953445 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953675 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953768 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.953983 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954286 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954383 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954595 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954680 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954893 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.954979 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955201 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955288 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955503 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955597 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955809 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.955898 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956116 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956208 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956426 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956514 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.956829 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957039 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957131 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957353 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957539 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957685 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.957773 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958004 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958091 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958314 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958409 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958623 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958710 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.958933 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959019 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959246 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959338 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959562 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959775 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.959863 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.960185 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.960298 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.960577 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.960692 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.960880 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961004 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961298 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961395 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961646 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961736 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.961954 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962042 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962261 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962359 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962578 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962665 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962889 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.962974 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963202 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963290 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963511 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963598 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963825 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.963915 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964132 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964219 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964437 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964530 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964752 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.964839 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965061 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965149 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965369 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965474 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965700 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.965788 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966010 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966099 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966319 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966408 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966628 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966724 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.966934 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967022 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967245 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967330 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967553 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967653 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967862 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.967949 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968174 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968261 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968480 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968580 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968787 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.968873 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969091 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969184 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969394 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969547 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969729 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.969828 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970036 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970121 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970340 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970427 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970654 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970781 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.970965 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971054 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971265 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971351 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971571 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971665 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971881 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.971977 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972187 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972274 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972494 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972581 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972799 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.972894 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973104 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973191 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973509 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973606 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973767 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.973867 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974102 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974196 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974411 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974499 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974733 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.974827 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.975047 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.975133 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.975372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.975460 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976213 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976382 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976535 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976689 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976806 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.976957 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977087 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977283 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977378 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977625 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977714 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.977963 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978064 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978279 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978366 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978584 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978669 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978890 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.978987 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979192 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979283 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979491 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979624 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979792 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.979893 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980092 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980191 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980397 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980485 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980697 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980793 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.980997 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981092 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981297 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981422 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981623 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981721 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.981927 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982026 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982227 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982322 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982533 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982621 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982834 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.982922 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983134 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983235 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983432 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983519 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983733 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.983820 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984032 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984128 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984361 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984449 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984682 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984777 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.984996 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985085 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985312 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985398 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985647 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985738 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.985969 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986053 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986279 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986373 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986599 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986694 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.986920 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987010 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987232 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987357 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987539 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987634 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987869 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.987959 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988178 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988273 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988487 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988588 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988796 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.988883 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.989104 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.989191 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.989411 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.989529 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.989722 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:22:09.989817 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.990049 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.990372 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.990675 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.990998 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.991438 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.991902 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.992213 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.992526 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.992856 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.993166 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.993492 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.993806 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.994115 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.994428 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.994742 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.995050 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.995357 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.995671 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.995984 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.996309 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.996634 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.996943 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.997268 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.997615 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.997956 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.998268 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.998606 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.998931 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.999245 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.999554 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:09.999861 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:22:10.000099 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:22:10.144318 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO dbcounter [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Registered counter for database nova_api Sep 01 05:22:10.153563 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO dbcounter [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Registered counter for database nova_api Sep 01 05:22:10.166060 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_db.sqlalchemy.engines [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.172757 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writer thread running {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.174412 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_db.sqlalchemy.engines [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.183285 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writer thread running {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.231268 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.context [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),291d5233-e21e-4cca-8c5b-c73b810bd8f5(cell1) {{(pid=105840) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:22:10.235037 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.235517 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.237093 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.237939 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.238372 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.240349 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.240898 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.context [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),291d5233-e21e-4cca-8c5b-c73b810bd8f5(cell1) {{(pid=105841) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:22:10.243008 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO dbcounter [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Registered counter for database nova_cell0 Sep 01 05:22:10.245723 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.246190 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.247042 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO dbcounter [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Registered counter for database nova_cell1 Sep 01 05:22:10.247744 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.248465 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.248975 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.250991 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_concurrency.lockutils [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.252994 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO dbcounter [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Registered counter for database nova_cell0 Sep 01 05:22:10.254241 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_db.sqlalchemy.engines [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.256007 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_db.sqlalchemy.engines [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.257313 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO dbcounter [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Registered counter for database nova_cell1 Sep 01 05:22:10.262459 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writer thread running {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.265068 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_db.sqlalchemy.engines [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.266306 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_db.sqlalchemy.engines [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.267760 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writer thread running {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.274044 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writer thread running {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.274381 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writer thread running {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.410609 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO dbcounter [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Registered counter for database nova_cell0 Sep 01 05:22:10.419390 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_db.sqlalchemy.engines [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.420572 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO dbcounter [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Registered counter for database nova_cell0 Sep 01 05:22:10.423823 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writer thread running {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.427013 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG oslo_db.sqlalchemy.engines [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:22:10.432593 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writer thread running {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:22:10.831033 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: WARNING keystonemiddleware.auth_token [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:22:10.838976 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: WARNING keystonemiddleware.auth_token [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:22:10.856939 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: WARNING keystonemiddleware.auth_token [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:22:10.864177 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: WARNING keystonemiddleware.auth_token [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:22:11.181734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: WARNING keystonemiddleware.auth_token [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:22:11.187746 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: WARNING keystonemiddleware.auth_token [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:22:11.193004 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564f710879c0 pid: 105840 (default app) Sep 01 05:22:11.195869 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.197090 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002524 Sep 01 05:22:11.197525 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:11.209181 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: WARNING keystonemiddleware.auth_token [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:22:11.216210 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: WARNING keystonemiddleware.auth_token [None req-99810d94-6283-44ac-9fd2-01e74e31ca45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:22:11.221426 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564f710879c0 pid: 105841 (default app) Sep 01 05:23:32.419517 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:32.420503 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 01 05:23:32.420904 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:32.437004 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_api:SELECT=3 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:32.438444 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_cell1:SELECT=3 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:32.439284 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_cell0:SELECT=3 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:32.440185 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:33.312874 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-7d17f720-3aee-40aa-ab79-f48901dd799b admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.346040 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-7d17f720-3aee-40aa-ab79-f48901dd799b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917934 Sep 01 05:23:33.346825 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:35.716211 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.717315 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-d82e72d1-206c-45b1-965b-25501cba6306 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 01 05:23:35.720612 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:36.148129 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-c634a1db-44e5-4011-8ef3-17b98c415a3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:36.260474 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-c634a1db-44e5-4011-8ef3-17b98c415a3f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.529929 Sep 01 05:23:36.260474 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:36.497035 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-6834b7c8-fcac-42d8-ac35-941efc23b784 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:36.520795 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_api:SELECT=3 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:36.521736 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_cell0:SELECT=3 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:36.522475 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_cell1:SELECT=3 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:36.523216 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:36.631850 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-6834b7c8-fcac-42d8-ac35-941efc23b784 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364949 Sep 01 05:23:36.632441 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 1 05:23:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:39.077490 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-c634a1db-44e5-4011-8ef3-17b98c415a3f admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.078761 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-c634a1db-44e5-4011-8ef3-17b98c415a3f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Sep 01 05:23:39.079651 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:39.790350 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-b5e5887b-0e51-4fd6-86e8-f85b1f6de99a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:39.911296 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-b5e5887b-0e51-4fd6-86e8-f85b1f6de99a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.824992 Sep 01 05:23:39.912416 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:39.924956 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-301f8bfd-e75e-4bbf-a375-d892bf0480b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:40.046267 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-301f8bfd-e75e-4bbf-a375-d892bf0480b7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125697 Sep 01 05:23:40.047088 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 1 05:23:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:42.465004 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-b5e5887b-0e51-4fd6-86e8-f85b1f6de99a admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:42.466058 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-b5e5887b-0e51-4fd6-86e8-f85b1f6de99a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 01 05:23:42.466721 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:42.880101 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-2adf84db-82b9-41a3-be26-791caf2991da admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:42.961196 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-2adf84db-82b9-41a3-be26-791caf2991da admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488034 Sep 01 05:23:42.961706 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:42.974676 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-863aa3b0-c0e0-43c8-987c-831702e81e4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:43.056610 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-863aa3b0-c0e0-43c8-987c-831702e81e4c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086609 Sep 01 05:23:43.057193 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 1 05:23:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:45.677540 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-2adf84db-82b9-41a3-be26-791caf2991da admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:45.678555 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-2adf84db-82b9-41a3-be26-791caf2991da admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 05:23:45.679231 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:46.103711 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-3ba26059-bd82-4d88-9290-558d71301c64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:46.197138 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-3ba26059-bd82-4d88-9290-558d71301c64 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511696 Sep 01 05:23:46.197708 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:46.210891 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-fc943fa3-3b8c-4fa6-b976-deb9ca931708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:46.308310 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-fc943fa3-3b8c-4fa6-b976-deb9ca931708 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102208 Sep 01 05:23:46.309141 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 1 05:23:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:48.760509 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-3ba26059-bd82-4d88-9290-558d71301c64 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:48.761542 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-3ba26059-bd82-4d88-9290-558d71301c64 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 01 05:23:48.761988 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:49.180007 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:49.297301 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529026 Sep 01 05:23:49.297916 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:49.310415 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-970938f6-f2c6-40ce-ab3b-5fd9fe3881d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:49.401017 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-970938f6-f2c6-40ce-ab3b-5fd9fe3881d4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093974 Sep 01 05:23:49.405707 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 1 05:23:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:51.779112 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:51.780189 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 01 05:23:51.780594 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:52.226008 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-cae0b0a0-bda5-4789-b43a-9c0cbbcc42ff admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:52.250919 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-cae0b0a0-bda5-4789-b43a-9c0cbbcc42ff admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462323 Sep 01 05:23:52.251574 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 1 05:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:54.879700 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:54.880767 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4d11d7d2-1c2f-4134-aea9-cf5e2cd5228e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 01 05:23:54.881191 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:55.296623 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-1690b3cf-25a0-4a56-9fad-36da91f17b05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:55.372407 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-1690b3cf-25a0-4a56-9fad-36da91f17b05 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.484797 Sep 01 05:23:55.372959 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:55.385854 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-da6ebf81-7ded-4c2d-a7e2-89a2b787b2e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:55.462268 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-da6ebf81-7ded-4c2d-a7e2-89a2b787b2e8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080096 Sep 01 05:23:55.462856 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 1 05:23:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:57.836291 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-1690b3cf-25a0-4a56-9fad-36da91f17b05 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:57.837296 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-1690b3cf-25a0-4a56-9fad-36da91f17b05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 01 05:23:57.837741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:58.230323 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-7f330dce-9b90-4a84-95c8-98917faa0bf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "name": "m1.small", "vcpus": 1, "disk": 20}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:58.333759 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-7f330dce-9b90-4a84-95c8-98917faa0bf9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489908 Sep 01 05:23:58.334336 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:23:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:58.347345 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-8af22142-8d16-499c-8bf0-cdf575147d1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:58.418008 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-8af22142-8d16-499c-8bf0-cdf575147d1b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074862 Sep 01 05:23:58.418598 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 1 05:23:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:00.833932 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-7f330dce-9b90-4a84-95c8-98917faa0bf9 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:00.834944 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-7f330dce-9b90-4a84-95c8-98917faa0bf9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 01 05:24:00.840626 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:01.285023 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-eadb0246-fd9e-4678-8b0b-d0d8c672ba96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "id": "3", "name": "m1.medium", "vcpus": 2, "ram": 4096}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:01.360978 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-eadb0246-fd9e-4678-8b0b-d0d8c672ba96 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519163 Sep 01 05:24:01.362968 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:24:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:01.376995 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-af11e722-c1b8-4a68-94f5-7848a90325b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:01.457350 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-af11e722-c1b8-4a68-94f5-7848a90325b2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086277 Sep 01 05:24:01.458148 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 1 05:24:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:03.860293 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-eadb0246-fd9e-4678-8b0b-d0d8c672ba96 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:03.861331 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-eadb0246-fd9e-4678-8b0b-d0d8c672ba96 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 01 05:24:03.861780 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:04.337341 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-03742389-76da-4cf3-8b6c-68fbe80491ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:04.344671 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:04.410019 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-03742389-76da-4cf3-8b6c-68fbe80491ce admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540571 Sep 01 05:24:04.411371 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:24:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:04.423572 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-6081bc84-f00a-460e-98c9-0b7d5dc79dbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:04.501951 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-6081bc84-f00a-460e-98c9-0b7d5dc79dbb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081920 Sep 01 05:24:04.502486 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 1 05:24:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:06.890027 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-03742389-76da-4cf3-8b6c-68fbe80491ce admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.891045 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-03742389-76da-4cf3-8b6c-68fbe80491ce admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 01 05:24:06.891628 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:07.343115 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "disk": 160, "name": "m1.xlarge", "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:07.429741 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.532099 Sep 01 05:24:07.437885 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 1 05:24:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:07.443488 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-5f4ad405-234b-432b-b4e8-6be6ac75e575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:07.560774 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-5f4ad405-234b-432b-b4e8-6be6ac75e575 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121892 Sep 01 05:24:07.561376 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 1 05:24:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:26.314963 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.315921 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Sep 01 05:24:26.316331 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:26.716024 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-650c8c8f-feba-45bd-b49c-7685fbf082df admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.740005 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-650c8c8f-feba-45bd-b49c-7685fbf082df admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412897 Sep 01 05:24:26.740551 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:27.816836 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:27.817894 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-e80cf912-7642-4e12-8873-8a4773cf94c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 01 05:24:27.818301 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:28.348809 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-c3ba929b-0a54-4ebf-b4a2-6cc0d80292b2 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.358633 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.wsgi [None req-c3ba929b-0a54-4ebf-b4a2-6cc0d80292b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-c3ba929b-0a54-4ebf-b4a2-6cc0d80292b2 admin admin] Request method failure captured: Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept: application/json Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept-Encoding: gzip, deflate Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Connection: keep-alive Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Content-Length: 0 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Host: 10.222.0.42 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-System-Scope: None Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: User-Agent: python-novaclient Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Auth-Token: gAAAAABjEEILJ2A2dn74kLKQJiJzft7cuWA6xbfGBfppD_TaEN0uc9qAdu-xHpHpHdc0-IMb0MYBsFe6bQFp44gwSMVgRy_1sSZyO9UF4-AS2bYdskdf13hFI3DxnOLFrvONWEeLi81eHkeHv7CHzOvCd0F6MNQWd99BvGbFDOwLZiXUYTF8hFY Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Id: None Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Name: None Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Identity-Status: Confirmed Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Is-Admin-Project: True Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Id: default Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Name: Default Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Name: admin Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Role: member,reader,admin Sep 01 05:24:28.362590 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Roles: member,reader,admin Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant: admin Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Name: admin Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User: admin Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Id: default Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Name: Default Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Name: admin Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: method: > Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: exception: Flavor 42 could not be found. Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: action_args: {'id': '42'} Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:28.364447 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:28.365552 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.367070 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-c3ba929b-0a54-4ebf-b4a2-6cc0d80292b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:28.368416 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-c3ba929b-0a54-4ebf-b4a2-6cc0d80292b2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406537 Sep 01 05:24:28.368416 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:28.373647 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-2d911181-48ec-4f3f-8f78-2923a3309644 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.377915 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:28.396854 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-2d911181-48ec-4f3f-8f78-2923a3309644 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026816 Sep 01 05:24:28.397386 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:28.408038 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-3e45f3c4-45b3-40f0-b177-e5e892ffea46 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.430445 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-3e45f3c4-45b3-40f0-b177-e5e892ffea46 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027058 Sep 01 05:24:28.430990 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:28.441141 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-95d068ed-5fe7-4265-ab6c-1df04714242a admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.447442 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.wsgi [None req-95d068ed-5fe7-4265-ab6c-1df04714242a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-95d068ed-5fe7-4265-ab6c-1df04714242a admin admin] Request method failure captured: Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept: application/json Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept-Encoding: gzip, deflate Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Connection: keep-alive Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Content-Length: 0 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Host: 10.222.0.42 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-System-Scope: None Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: User-Agent: python-novaclient Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Auth-Token: gAAAAABjEEILJ2A2dn74kLKQJiJzft7cuWA6xbfGBfppD_TaEN0uc9qAdu-xHpHpHdc0-IMb0MYBsFe6bQFp44gwSMVgRy_1sSZyO9UF4-AS2bYdskdf13hFI3DxnOLFrvONWEeLi81eHkeHv7CHzOvCd0F6MNQWd99BvGbFDOwLZiXUYTF8hFY Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Id: None Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Name: None Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Identity-Status: Confirmed Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Is-Admin-Project: True Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Id: default Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Name: Default Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Name: admin Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Role: member,reader,admin Sep 01 05:24:28.450734 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Roles: member,reader,admin Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant: admin Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Name: admin Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User: admin Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Id: default Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Name: Default Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Name: admin Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: method: > Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: exception: Flavor 42 could not be found. Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: action_args: {'id': '42'} Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:28.456136 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:28.457086 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:28.458185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-95d068ed-5fe7-4265-ab6c-1df04714242a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:28.459199 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-95d068ed-5fe7-4265-ab6c-1df04714242a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015201 Sep 01 05:24:28.459199 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:29.543572 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-3e45f3c4-45b3-40f0-b177-e5e892ffea46 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.544626 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-3e45f3c4-45b3-40f0-b177-e5e892ffea46 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 01 05:24:29.545022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:30.081090 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-fe6f6459-8f9d-4029-999b-6a6973803a4d admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.086500 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.wsgi [None req-fe6f6459-8f9d-4029-999b-6a6973803a4d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-fe6f6459-8f9d-4029-999b-6a6973803a4d admin admin] Request method failure captured: Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept: application/json Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept-Encoding: gzip, deflate Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Connection: keep-alive Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Content-Length: 0 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Host: 10.222.0.42 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-System-Scope: None Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: User-Agent: python-novaclient Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Auth-Token: gAAAAABjEEIN4EooRZlk5naqBwHv4jSqBODO7s-O6rv-Xgz3lFuZ57KiBn9vp2vTJx29MLAU-H5OTCOfHfY6v1WD6RLNXF6s3JeqdAkD0vuIFC2p2rGqDgYSSxyTB39EQctPjTZ-6Eebjy31TXJOtmj7nIDiTKG97nN6oufdD0gPtePOnVJ9o88 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Id: None Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Name: None Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Identity-Status: Confirmed Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Is-Admin-Project: True Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Id: default Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Name: Default Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Name: admin Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Role: member,reader,admin Sep 01 05:24:30.087984 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Roles: member,reader,admin Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant: admin Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Name: admin Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User: admin Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Id: default Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Name: Default Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Name: admin Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: method: > Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: exception: Flavor 84 could not be found. Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: action_args: {'id': '84'} Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:30.089548 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:30.090469 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.091779 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-fe6f6459-8f9d-4029-999b-6a6973803a4d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:30.093185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-fe6f6459-8f9d-4029-999b-6a6973803a4d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405017 Sep 01 05:24:30.093185 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:30.098996 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-9e303121-03e7-4d19-be64-e7e19b411408 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.113911 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-9e303121-03e7-4d19-be64-e7e19b411408 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018472 Sep 01 05:24:30.114466 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:30.123652 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-b26c6c20-079f-4b90-a473-c8545e8a0df1 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.138937 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-b26c6c20-079f-4b90-a473-c8545e8a0df1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018734 Sep 01 05:24:30.139446 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:30.149098 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-d9349174-365e-42d0-8b6b-d57008607c30 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.154324 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.wsgi [None req-d9349174-365e-42d0-8b6b-d57008607c30 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-d9349174-365e-42d0-8b6b-d57008607c30 admin admin] Request method failure captured: Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept: application/json Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept-Encoding: gzip, deflate Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Connection: keep-alive Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Content-Length: 0 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Host: 10.222.0.42 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-System-Scope: None Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: User-Agent: python-novaclient Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Auth-Token: gAAAAABjEEIN4EooRZlk5naqBwHv4jSqBODO7s-O6rv-Xgz3lFuZ57KiBn9vp2vTJx29MLAU-H5OTCOfHfY6v1WD6RLNXF6s3JeqdAkD0vuIFC2p2rGqDgYSSxyTB39EQctPjTZ-6Eebjy31TXJOtmj7nIDiTKG97nN6oufdD0gPtePOnVJ9o88 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Id: None Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Name: None Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Identity-Status: Confirmed Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Is-Admin-Project: True Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Id: default Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Name: Default Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Name: admin Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Role: member,reader,admin Sep 01 05:24:30.155814 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Roles: member,reader,admin Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant: admin Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Name: admin Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User: admin Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Id: default Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Name: Default Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Name: admin Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: method: > Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: exception: Flavor 84 could not be found. Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: action_args: {'id': '84'} Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:30.157448 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:30.158560 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:30.160022 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-d9349174-365e-42d0-8b6b-d57008607c30 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:30.161288 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-d9349174-365e-42d0-8b6b-d57008607c30 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011505 Sep 01 05:24:30.161288 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:31.122414 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-b26c6c20-079f-4b90-a473-c8545e8a0df1 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.123453 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-b26c6c20-079f-4b90-a473-c8545e8a0df1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 01 05:24:31.123855 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:31.642663 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-dfaa34ea-c1b0-43fb-9f76-8b814dc7e3e5 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.648381 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.wsgi [None req-dfaa34ea-c1b0-43fb-9f76-8b814dc7e3e5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-dfaa34ea-c1b0-43fb-9f76-8b814dc7e3e5 admin admin] Request method failure captured: Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept: application/json Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Accept-Encoding: gzip, deflate Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Connection: keep-alive Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Content-Length: 0 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Host: 10.222.0.42 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Openstack-System-Scope: None Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: User-Agent: python-novaclient Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Auth-Token: gAAAAABjEEIPJt3PfnhITtiUaWPcRaqK99Yy43R8kRMsn3UVaIUacGZ6ks-rj1N8SfKDjYUMK5WL4SFcYl-7e8cyAc0deqDH4FmCnccOJwCPJWIs1XFUcpIXSaAm5EwMHdYjPNAKOKRisa22AThPLgHVdLd_1atrUCzHuXSb2i2PCo_64yru6U4 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Id: None Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Domain-Name: None Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Identity-Status: Confirmed Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Is-Admin-Project: True Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Id: default Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Domain-Name: Default Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Project-Name: admin Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Role: member,reader,admin Sep 01 05:24:31.649907 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Roles: member,reader,admin Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant: admin Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-Tenant-Name: admin Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User: admin Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Id: default Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Domain-Name: Default Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: X-User-Name: admin Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: method: > Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: exception: Flavor 451 could not be found. Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: action_args: {'id': '451'} Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:31.651494 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:31.652408 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.653558 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-dfaa34ea-c1b0-43fb-9f76-8b814dc7e3e5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:31.654786 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-dfaa34ea-c1b0-43fb-9f76-8b814dc7e3e5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389739 Sep 01 05:24:31.654786 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:31.661419 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-cb77a7aa-d146-4a9d-ae42-aa9ee74ceaa8 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.677206 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-cb77a7aa-d146-4a9d-ae42-aa9ee74ceaa8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019412 Sep 01 05:24:31.677771 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:31.687017 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.701831 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018234 Sep 01 05:24:31.702342 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:31.711630 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-23afe4a5-ebc4-490f-ad06-b5fa7062d1ea admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.717269 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.wsgi [None req-23afe4a5-ebc4-490f-ad06-b5fa7062d1ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-23afe4a5-ebc4-490f-ad06-b5fa7062d1ea admin admin] Request method failure captured: Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept: application/json Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Accept-Encoding: gzip, deflate Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Connection: keep-alive Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Content-Length: 0 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Host: 10.222.0.42 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-Api-Version: compute 2.90 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Openstack-System-Scope: None Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: User-Agent: python-novaclient Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Auth-Token: gAAAAABjEEIPJt3PfnhITtiUaWPcRaqK99Yy43R8kRMsn3UVaIUacGZ6ks-rj1N8SfKDjYUMK5WL4SFcYl-7e8cyAc0deqDH4FmCnccOJwCPJWIs1XFUcpIXSaAm5EwMHdYjPNAKOKRisa22AThPLgHVdLd_1atrUCzHuXSb2i2PCo_64yru6U4 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Id: None Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Domain-Name: None Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Identity-Status: Confirmed Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Is-Admin-Project: True Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Id: default Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Domain-Name: Default Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Project-Name: admin Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Role: member,reader,admin Sep 01 05:24:31.718879 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Roles: member,reader,admin Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_61f9dee9572644e580e35da89b6265e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/61f9dee9572644e580e35da89b6265e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant: admin Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Id: 61f9dee9572644e580e35da89b6265e9 Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-Tenant-Name: admin Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User: admin Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Id: default Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Domain-Name: Default Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Id: 9d4d38ef7ecd40a380aba27a2b564d42 Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: X-User-Name: admin Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: method: > Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: exception: Flavor 451 could not be found. Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: action_args: {'id': '451'} Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:31.721071 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:31.722051 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: ERROR nova.api.openstack.wsgi Sep 01 05:24:31.723492 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-23afe4a5-ebc4-490f-ad06-b5fa7062d1ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:31.724928 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-23afe4a5-ebc4-490f-ad06-b5fa7062d1ea admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012656 Sep 01 05:24:31.724928 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:32.701844 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.702909 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 01 05:24:32.703302 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:33.250556 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-01f6826a-117e-40a6-9e18-197a4f6709c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:33.354047 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-01f6826a-117e-40a6-9e18-197a4f6709c9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.509031 Sep 01 05:24:33.354600 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 1 05:24:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:34.333989 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:34.335033 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 01 05:24:34.335428 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:34.861716 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-fad82b10-8dcb-48d9-bc0f-4c72cc4824eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:34.931016 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-fad82b10-8dcb-48d9-bc0f-4c72cc4824eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.456819 Sep 01 05:24:34.931479 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 1 05:24:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:35.900947 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:35.902143 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 01 05:24:35.902542 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:36.424331 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-b7ebc445-fb1b-4244-9d97-a5cdca871de5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:36.495110 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-b7ebc445-fb1b-4244-9d97-a5cdca871de5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.453589 Sep 01 05:24:36.495578 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 1 05:24:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:37.470442 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:37.471443 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 01 05:24:37.471834 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:37.993908 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-871c632b-ac16-4ef4-a641-46d931f73e8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:38.068039 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-871c632b-ac16-4ef4-a641-46d931f73e8f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.459372 Sep 01 05:24:38.068586 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 1 05:24:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:39.052504 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:39.053544 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 01 05:24:39.053967 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:39.583747 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-cff89230-7417-4253-a656-436eb28b62ac admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:39.604241 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-cff89230-7417-4253-a656-436eb28b62ac admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408456 Sep 01 05:24:39.604774 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Sep 1 05:24:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:33.641023 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:33.642072 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-4560b2c2-a676-40ea-994a-2680374840e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 01 05:25:33.642479 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 1 05:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:33.652747 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:34.039902 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-7af623e7-e646-40c6-a0ab-f7c4d6947c6f admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.060801 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-7af623e7-e646-40c6-a0ab-f7c4d6947c6f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412435 Sep 01 05:25:34.061350 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 1 05:25:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:34.082926 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG dbcounter [-] [105841] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:34.086614 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-06664a23-0905-4f84-a92c-fe805dcc40c0 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.094317 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-06664a23-0905-4f84-a92c-fe805dcc40c0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012814 Sep 01 05:25:34.094835 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:34.107097 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-664c87d4-acf4-495d-9ec6-f8cb8cdb3d46 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.115118 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-664c87d4-acf4-495d-9ec6-f8cb8cdb3d46 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012303 Sep 01 05:25:34.115644 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:34.128143 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.135652 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011398 Sep 01 05:25:34.136167 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:34.147961 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-48f9c42b-b7ca-4626-b6de-10b13e2b4bd9 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.155651 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-48f9c42b-b7ca-4626-b6de-10b13e2b4bd9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011248 Sep 01 05:25:34.156165 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:28:41.090705 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:41.091901 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Sep 01 05:28:41.092323 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:41.232541 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_api:SELECT=6 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:41.396751 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:41.400428 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.400926 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.401338 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.402084 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.402533 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.402954 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.436504 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-814321be-ff23-4c54-a3a6-63d72b1fe60d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.205401 Sep 01 05:28:41.437054 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:28:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:28:42.276026 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:42.277053 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 01 05:28:42.277426 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:42.468995 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:42.472403 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:42.472876 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:42.473299 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:42.474559 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:42.475069 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:42.475483 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:42.494817 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-1552dfb7-8759-4626-aa27-1b0cb5f9e3a3 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077254 Sep 01 05:28:42.495302 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:28:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:28:53.766971 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:53.768015 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 01 05:28:53.768413 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:53.911861 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_cell0:SELECT=4 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:53.912585 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_cell1:SELECT=4 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:53.913202 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG dbcounter [-] [105840] Writing DB stats nova_api:SELECT=8 {{(pid=105840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:53.961511 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:53.965003 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:53.965497 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:53.965931 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:53.966710 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:53.967166 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:53.967577 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:53.993851 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-4fb2b2c2-70ca-4ea3-8f16-717acf38255c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086318 Sep 01 05:28:53.994345 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:28:53 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:28:54.835148 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: DEBUG nova.api.openstack.wsgi [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] Calling method '>' {{(pid=105841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:54.836149 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: INFO nova.api.openstack.requestlog [None req-ecf355fb-0257-41be-b110-6014f4180b29 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 01 05:28:54.836544 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: [pid: 105841|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 1 05:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:55.027559 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG nova.api.openstack.wsgi [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Calling method '>' {{(pid=105840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:55.031001 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:55.031474 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:55.031902 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:55.032613 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:55.033056 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:55.033496 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: DEBUG oslo_concurrency.lockutils [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:55.055670 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: INFO nova.api.openstack.requestlog [None req-83515c9a-3731-48e3-84c1-181a7dd544cd admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079872 Sep 01 05:28:55.056268 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: [pid: 105840|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 1 05:28:54 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:52.767920 dv-cinder-852208-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 05:29:52.768456 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: Thu Sep 1 05:29:52 2022 - graceful shutdown triggered... Sep 01 05:29:52.768890 dv-cinder-852208-15-iscsi devstack@n-api.service[105841]: Gracefully killing worker 2 (pid: 105841)... Sep 01 05:29:52.769826 dv-cinder-852208-15-iscsi devstack@n-api.service[105840]: Gracefully killing worker 1 (pid: 105840)... Sep 01 05:29:53.768819 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: worker 1 buried after 1 seconds Sep 01 05:29:53.768819 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: worker 2 buried after 1 seconds Sep 01 05:29:53.768819 dv-cinder-852208-15-iscsi devstack@n-api.service[105839]: goodbye to uWSGI. Sep 01 05:29:53.770409 dv-cinder-852208-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 05:29:53.770947 dv-cinder-852208-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 05:29:53.773757 dv-cinder-852208-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:29:53.785814 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:29:53 2022] *** Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: nodename: dv-cinder-852208-15-iscsi Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: machine: x86_64 Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: clock source: unix Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: pcre jit disabled Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: detected number of CPU cores: 4 Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: current working directory: / Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:29:53.787836 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: your processes number limit is 47680 Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: your memory page size is 4096 bytes Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: detected max file descriptor number: 2048 Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: lock engine: pthread robust mutexes Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: thunder lock: enabled Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:29:53.788616 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:29:53.829921 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: Python main interpreter initialized at 0x560ccf7559c0 Sep 01 05:29:53.829921 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: python threads support enabled Sep 01 05:29:53.829921 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: your server socket listen backlog is limited to 100 connections Sep 01 05:29:53.829921 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:29:53.830271 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:29:53.830353 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: *** Operational MODE: preforking *** Sep 01 05:29:53.830643 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:29:53.830643 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: spawned uWSGI master process (pid: 121012) Sep 01 05:29:53.830840 dv-cinder-852208-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:29:53.831423 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: spawned uWSGI worker 1 (pid: 121031, cores: 1) Sep 01 05:29:53.832463 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: spawned uWSGI worker 2 (pid: 121033, cores: 1) Sep 01 05:29:53.832849 dv-cinder-852208-15-iscsi devstack@n-api.service[121012]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:29:54.514976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:29:54.515597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:29:55.690161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:29:55.690161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: from cryptography.utils import int_from_bytes Sep 01 05:29:55.691307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:29:55.691307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: from cryptography.utils import int_from_bytes Sep 01 05:29:55.701782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:29:55.701782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: from cryptography.utils import int_from_bytes Sep 01 05:29:55.702275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:29:55.702275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: from cryptography.utils import int_from_bytes Sep 01 05:29:58.188803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:29:58.189670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:29:58.190089 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:29:58.190202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:29:58.190282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:29:58.190363 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:29:58.190447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:29:58.190533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:29:58.190626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:29:58.190710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:29:58.190802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.190888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.190961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191468 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.191980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.192943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193533 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.193989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-15-iscsi {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-15-iscsi {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194666 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.194999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.195973 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.196130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.196300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.196485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.198664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.198936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.199174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.199446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.199446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.199915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.200148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.200382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.200382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.200824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.201045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.201267 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.201516 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.201728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.201972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.202216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.202435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.202739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.203163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.203454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.203697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.203940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.204138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.204292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.204450 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-15-iscsi {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.204659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-15-iscsi {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.205365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.205556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.205865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.206060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.206191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.206308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.206741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.206885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.207020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.208097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.208750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.208890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.209009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.209131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.209302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.209528 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.209682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.212725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.212915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.213095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.213260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.213412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.213642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.213829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.214216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.214387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.214537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.214693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.214900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215457 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215618 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.215975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.216954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.217109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.217270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.217448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.217679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.217835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218360 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.218851 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.219007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.219164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.219389 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220463 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220775 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.220923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.221557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.221766 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.222550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.223260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.223425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.223624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.223831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.223987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.224175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.224343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.224536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.224696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.224853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.225942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.226892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.227990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.228151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.228348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.228540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.228701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.228855 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.229011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.229587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.229804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.230959 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231530 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231670 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.231967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.232985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.233123 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.233266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.233417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.233619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.233783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234406 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.234998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.235882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.236927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.237091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.237247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.237423 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.238974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239436 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.239934 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.240994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.241772 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.246955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247265 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.247878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248019 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.248481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.249647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.250939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.252213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.252213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.252213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.252213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.252822 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.252970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.253259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.253442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.253442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.253442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.253442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.253442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.254304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.254454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.254454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.254749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.254903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.254903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.255380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.255537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.255685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.255831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.255977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.256123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.256279 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.256447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.256602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.256757 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.256904 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.257064 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.257064 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.257362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.257589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.257760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.257989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.258147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.258344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.258504 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:29:58.258671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.258820 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.258967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.259993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.260820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261133 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.261994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.262975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.263866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.264925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265762 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.265959 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266609 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.266987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.267785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268207 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268904 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.268989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.269965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270189 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.270913 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.271412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.272837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.273499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.273499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.273499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.276670 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.276812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.276986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.277831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278097 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278240 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278671 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.278986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279800 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.279948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.280921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.281063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.281361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.281557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.281557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.281895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.282827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.283922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.284166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.284845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.284845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.285949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.286472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.286622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.286622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.286900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.287874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.288852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.289023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.289275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.289413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.289653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.289819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.290005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.290323 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.290459 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.290626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.290927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.291072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.291241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.291547 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.291719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.291868 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.292201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.292359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.292502 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.292789 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.292932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.293108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.293419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.293582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.293772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.293920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.294087 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.294361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.294499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.294699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.294840 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295437 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295778 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.295957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.296165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.296310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.296567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.296772 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.296914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.298846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.299827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.300934 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.301072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.301342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.301705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.301861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.302018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.302312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.302461 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.302626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.302926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.303963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.304129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.304402 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.304550 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.304741 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.304899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.305056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.305347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.305537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.305767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.305910 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306239 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.306894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307016 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307215 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.307989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.308974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.309118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.309315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.309438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.309887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310160 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.310945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.311081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.311262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.311437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.311608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.312156 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.312442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.312597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.312739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.313047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.313223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.313370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.313684 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.313822 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.314927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.315109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.315262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.315557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.315705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.316620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.316767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.316902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.317920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.318197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.318328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.318462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.318596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.319288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.319646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.320412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.320571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.320835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.321248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.321720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.322625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.322977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.323394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.323716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.323984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.324439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.324812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.325203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.327128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.327128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.329593 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.329697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.329864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.329958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330122 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.330973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.331053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.331126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.331126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.331819 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.332225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.332434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.332604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.332758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333059 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333406 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333653 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.333993 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334775 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.334957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335717 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.335981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336584 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.336910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.337031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.337190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.337330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.337575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.341554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.341786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.341951 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342756 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.342910 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.343993 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344160 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344616 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.344915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345764 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.345911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346237 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346383 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.346914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.347083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.347231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.347384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.347531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.347955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.348897 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.349122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.349292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.349575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.349736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.349881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350215 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.350979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.351274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.351477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.351627 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.351781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.351934 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.352995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.353966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.354879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.355949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356258 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.356882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.357038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.357192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.357339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.357528 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.357692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.358876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.359376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.359541 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.359900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360657 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.360966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.361125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.361284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.361497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.361744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.361903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.362050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.362196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.362343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363512 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.363990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.364880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365756 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.365903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366516 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366516 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.366960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.367106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.368224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.368224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.368224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.368665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.368810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.369134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.369483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.369887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.370834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.371968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372115 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.372890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373534 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373702 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.373892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.374968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375121 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.375874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376781 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.376926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.377975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.378579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.378796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.378987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.379143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.379310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.379476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.379699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.379867 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380464 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.380914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381067 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.381871 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.382925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.383997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.384935 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.385092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.385255 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.385427 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.385721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.385890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.386050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.386196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.386343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387757 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.387915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.388060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.388206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.388206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.388754 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.388906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.389052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.389198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.389354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.390482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.390648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.390804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.390961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.391895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.392955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.393118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.393266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.393420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.394305 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.394487 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.394716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.394884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395483 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.395879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396335 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396785 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.396931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.397902 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.398062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.398216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.398377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.398543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.398543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399104 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399754 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.399919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400078 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400398 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.400992 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.401144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.401144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.401448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.401704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.401857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402189 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402506 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.402971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.403909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404558 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.404862 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405175 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.405971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.406297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.406450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.406608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.406760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.406921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.407872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.408025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.408186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.408346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.408498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.408498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409350 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.409884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.410184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.410337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.410500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.410741 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.410741 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411372 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411372 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411821 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.411990 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.412726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.412892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.412892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.413197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.413350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.413539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.413714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.413876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.414049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.414329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.414488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.414650 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.414803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.415979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.416922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.417898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.418197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.418360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.418523 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.418684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.418684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.419006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.419400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.419577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.419744 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.419904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.420936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.421981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422483 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422986 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.422986 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.423305 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.423462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.423622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.423776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.423928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.424099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.424260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.424260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.424668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.424829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.425572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.425572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.425889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.426854 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.427870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428982 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.428982 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429505 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.429985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.430422 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.430582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.430749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.430994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.431799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.432882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.433697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.433697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.433999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.434161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.434313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.434573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.434733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.434888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435529 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435833 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.435986 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.436146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.436310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.436471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.436633 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.436786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.437210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.437373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.437574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.437733 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.437894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438530 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.438887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.439048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.439204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.439662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.439860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440731 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.440889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.441133 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.441435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.441619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.441776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.441943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.442136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.442457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.442787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.443106 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.443428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.443747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.444065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.444403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.444736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.445070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.445414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.445812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.446096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.446418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.446741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.446976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.447159 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.447326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.447490 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.447667 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.447837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.448963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.449117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.449268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.449440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.449802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.449978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450133 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.450935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.451987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.452940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453255 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453794 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.453960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.454119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.454272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.454432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.454622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.454871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.455861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.456084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.456843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.457201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.457372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.457572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.457731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.457883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.458048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.458210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.458210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.458210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.465606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.466712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.466900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.467870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.468955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469527 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469688 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.469841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.470947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.471446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.472847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.474969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.475269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.475269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.475576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.475738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.475907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.476689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.477884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.478747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.478747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.478747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.479210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.479368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.480102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.480102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.480429 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.480595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.480981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.481176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.481472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.481645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.481811 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.481998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.482959 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483591 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483753 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.483915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.484876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.485028 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.485190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.485342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.489104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.489343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.490308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.490708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.491126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.491420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.491684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.492027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.492368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.492542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.492703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.492872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.493038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.493199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.493415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.493652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.493966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.494325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.494663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.494822 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.494992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495513 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495669 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.495990 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.496141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.496309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.496600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.496898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.497055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.497284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.497440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.497659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.497958 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.498274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.499033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.499393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.499726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.500051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.501663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.501663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.501663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.510929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511558 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511793 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511793 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.511793 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.512961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.513538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.514041 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.514041 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.514261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.514573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.514849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.515535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.515859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.516205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.516557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.516889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.517214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.520025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.520399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.520747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.521089 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.521430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.521790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.522127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.522460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.522788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.523116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.523448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.523779 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.524121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.524461 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.524784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.525121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.525472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.525894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.526219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.526578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.526914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.527241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.527561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.527879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:29:58.528129 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:29:58.589205 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO dbcounter [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Registered counter for database nova_api Sep 01 05:29:58.595046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Registered counter for database nova_api Sep 01 05:29:58.612378 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_db.sqlalchemy.engines [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.617192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.620608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writer thread running {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.624673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.681607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.context [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),291d5233-e21e-4cca-8c5b-c73b810bd8f5(cell1) {{(pid=121033) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:29:58.683585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.context [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),291d5233-e21e-4cca-8c5b-c73b810bd8f5(cell1) {{(pid=121031) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:29:58.685710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.686179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.688082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.688984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.689113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.689557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.690110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.691994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.692253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.693211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.693894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.694037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO dbcounter [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Registered counter for database nova_cell0 Sep 01 05:29:58.696562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.698112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO dbcounter [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Registered counter for database nova_cell1 Sep 01 05:29:58.698835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Registered counter for database nova_cell0 Sep 01 05:29:58.703525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Registered counter for database nova_cell1 Sep 01 05:29:58.706322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_db.sqlalchemy.engines [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.707625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_db.sqlalchemy.engines [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.710449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.716636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.718692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writer thread running {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.719056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writer thread running {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.720728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.866210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.871604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO dbcounter [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Registered counter for database nova_cell0 Sep 01 05:29:58.876703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Registered counter for database nova_cell0 Sep 01 05:29:58.878256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_db.sqlalchemy.engines [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.883126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writer thread running {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:58.885227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:29:58.889635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:29:59.211021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: WARNING keystonemiddleware.auth_token [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:29:59.211562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:29:59.218341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: WARNING keystonemiddleware.auth_token [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:29:59.218677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:29:59.571225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:29:59.577229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-b027e827-4739-49be-8735-bac29ed8c511 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:29:59.577383 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: WARNING keystonemiddleware.auth_token [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:29:59.583013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ccf7559c0 pid: 121031 (default app) Sep 01 05:29:59.583860 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: WARNING keystonemiddleware.auth_token [None req-e494c378-17a2-41c1-9062-0cb2acd12ba8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:29:59.589157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ccf7559c0 pid: 121033 (default app) Sep 01 05:30:37.868206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:37.869879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:37.876150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:37.876150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:39.281178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:39.283182 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:39.288251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:39.289482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:39.509046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee63cb9-929c-4509-89dc-0d2f49812a48 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Action: 'create', calling method: .version_select at 0x7fbb6c95c160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1929248553", "metadata": {"Type": "work"}}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee63cb9-929c-4509-89dc-0d2f49812a48 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 122 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:39.518206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1929248553", "metadata": {"Type": "work"}}} Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:39.519556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1929248553', 'metadata': {'Type': 'work'}}}} Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:39.520394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:30:39.521767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:30:39.525185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:30:39.525185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.525185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee63cb9-929c-4509-89dc-0d2f49812a48 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:39.528261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dee63cb9-929c-4509-89dc-0d2f49812a48 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.670901 Sep 01 05:30:39.536056 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 1 05:30:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1674 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:30:39.544993 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-00b2b292-91cc-4420-9fb0-3058399e5712 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Action: 'create', calling method: .version_select at 0x7fbb6c95ce50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-637996067", "metadata": {"Type": "work"}}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-00b2b292-91cc-4420-9fb0-3058399e5712 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 119 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:39.549842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-637996067", "metadata": {"Type": "work"}}} Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:39.557945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-637996067', 'metadata': {'Type': 'work'}}}} Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi '0' Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:39.558734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:30:39.559989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:30:39.563334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:30:39.563334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.563334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-00b2b292-91cc-4420-9fb0-3058399e5712 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:39.563334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-00b2b292-91cc-4420-9fb0-3058399e5712 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014348 Sep 01 05:30:39.563334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 2/2] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 1 05:30:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:30:39.569065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-30c71233-72cd-49e6-89bb-01ed373e380b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Action: 'create', calling method: .version_select at 0x7fbb6c87fd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-404214219", "metadata": {"Type": "work"}}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-30c71233-72cd-49e6-89bb-01ed373e380b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 118 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:39.574003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-404214219", "metadata": {"Type": "work"}}} Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:39.576095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-404214219', 'metadata': {'Type': 'work'}}}} Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi '' Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:39.576898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:30:39.578251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:30:39.579917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:30:39.579917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:39.579917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-30c71233-72cd-49e6-89bb-01ed373e380b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:39.579917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-30c71233-72cd-49e6-89bb-01ed373e380b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011793 Sep 01 05:30:39.583234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 3/3] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 1 05:30:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:30:39.588505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d5e0c1f3-ce82-4337-87c5-db53fdeab85b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Calling method '.version_select at 0x7fbb6c87fa60>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.020131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-77afdea9-9321-4638-bc12-7a9d620ce80e tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Action: 'create', calling method: .version_select at 0x7fbb6c95c0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1440970088", "metadata": {"Type": "work"}}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:40.033806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-d5e0c1f3-ce82-4337-87c5-db53fdeab85b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] HTTP exception thrown: Volume tempest-invalid-1968314452 could not be found. Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d5e0c1f3-ce82-4337-87c5-db53fdeab85b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1968314452 HTTP/1.1 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:40.038654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume tempest-invalid-1968314452 could not be found. Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'tempest-invalid-1968314452'} Sep 01 05:30:40.046588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1968314452 could not be found. (HTTP 404) (Request-ID: req-6889fee2-02b0-4ddc-b321-d9c49028e3b6) Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.048410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:40.049797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1968314452 could not be found. Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:40.050928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1968314452 could not be found. Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1968314452 could not be found. Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d5e0c1f3-ce82-4337-87c5-db53fdeab85b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 404 to user: Volume tempest-invalid-1968314452 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d5e0c1f3-ce82-4337-87c5-db53fdeab85b tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1968314452" status: 404 len: 99 microversion: 2.1 time: 0.455880 Sep 01 05:30:40.054293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 1 05:30:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1968314452 => generated 99 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:30:40.058089 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-12915ddd-ea8e-41fb-8d6d-a53e4bdaad0e tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004733 Sep 01 05:30:40.066481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 1 05:30:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:30:40.080388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-42a3292d-9e8b-44b0-a4be-16abf1d16ef3 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008540 Sep 01 05:30:40.086590 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:30:40.103018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ddbcf6a-3439-46ba-a511-4a1763a67957 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Calling method '.version_select at 0x7fbb6c74b040>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.196720 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-7ddbcf6a-3439-46ba-a511-4a1763a67957 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] HTTP exception thrown: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ddbcf6a-3439-46ba-a511-4a1763a67957 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/os-volumes/9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 HTTP/1.1 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:40.201444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0'} Sep 01 05:30:40.202926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. (HTTP 404) (Request-ID: req-2bb34a69-6b24-4295-9163-73112e0b6e4b) Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.203757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:40.207071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:30:40.209435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ddbcf6a-3439-46ba-a511-4a1763a67957 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 404 to user: Volume 9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7ddbcf6a-3439-46ba-a511-4a1763a67957 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0" status: 404 len: 109 microversion: 2.1 time: 0.127566 Sep 01 05:30:40.221164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:30:40 2022] DELETE /compute/v2.1/os-volumes/9bc10db5-2ffc-4ff0-bc56-a5eab5d949a0 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:40.236400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a68dd4b2-0af5-42e2-ae5d-3f9ab46b60a8 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Calling method '.version_select at 0x7fbb6c7ad940>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.282125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-a68dd4b2-0af5-42e2-ae5d-3f9ab46b60a8 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] HTTP exception thrown: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a68dd4b2-0af5-42e2-ae5d-3f9ab46b60a8 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Request method failure captured: Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/os-volumes/9e736f4d-3395-4a07-8f1e-ea8592585853 HTTP/1.1 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9uMLP5bgEocK3bU-3cIgb3QucaQA_3vMDIGFam0antUmJ67OXytNEkvVs3lbNhJOvJXYiZrGqOzPgu6XYnfp-XQwl2wl57nKcnM-izmErwdYtC8L9IgN6EKukGywo6tyvjqrSD0dlY-K1eIo3Th3a5OjyEEz3-2pPKE-hn0aJT1Q Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:40.285408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f47b0b8077c444beb5876368b9d76363", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f47b0b8077c444beb5876368b9d76363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: f47b0b8077c444beb5876368b9d76363 Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesNegativeTest-1962417069 Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa090812e814881af3e130d2615399f Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesNegativeTest-1962417069-project Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '9e736f4d-3395-4a07-8f1e-ea8592585853'} Sep 01 05:30:40.286722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. (HTTP 404) (Request-ID: req-cda6678f-348b-46e4-a2b6-e5ce1f30166b) Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.287496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:40.288661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:30:40.289796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a68dd4b2-0af5-42e2-ae5d-3f9ab46b60a8 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] Returning 404 to user: Volume 9e736f4d-3395-4a07-8f1e-ea8592585853 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a68dd4b2-0af5-42e2-ae5d-3f9ab46b60a8 tempest-VolumesNegativeTest-1962417069 tempest-VolumesNegativeTest-1962417069-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e736f4d-3395-4a07-8f1e-ea8592585853" status: 404 len: 109 microversion: 2.1 time: 0.061694 Sep 01 05:30:40.290930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 8/8] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/os-volumes/9e736f4d-3395-4a07-8f1e-ea8592585853 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:41.851053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-77afdea9-9321-4638-bc12-7a9d620ce80e tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.586589 Sep 01 05:30:41.862239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 1/9] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 1 05:30:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2599 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 01 05:30:41.868552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a5978a65-0ef9-49fb-97e3-3c1175bc9cc4 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c87f820>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:41.977552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a5978a65-0ef9-49fb-97e3-3c1175bc9cc4 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 200 len: 353 microversion: 2.1 time: 0.114350 Sep 01 05:30:41.978195 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 9/10] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:41 2022] GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:42.230995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-56960eb0-f88e-4ed0-a034-0c9d9c94c8cd tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c83e040>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.365058 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-56960eb0-f88e-4ed0-a034-0c9d9c94c8cd tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7c754b48-db26-4f08-bddc-c2b5f86e6d2d" status: 200 len: 351 microversion: 2.1 time: 0.145010 Sep 01 05:30:42.373783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 2/11] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/os-volumes/7c754b48-db26-4f08-bddc-c2b5f86e6d2d => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:42.991508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2d259cf9-91d0-4891-97c0-71fb2dbf71ff tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c7ade50>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.083382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2d259cf9-91d0-4891-97c0-71fb2dbf71ff tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 200 len: 354 microversion: 2.1 time: 0.095675 Sep 01 05:30:43.084130 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 10/12] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:43.098336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4702bc93-5671-416c-9e4f-559473e7c612 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c83e790>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.204664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4702bc93-5671-416c-9e4f-559473e7c612 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 200 len: 354 microversion: 2.1 time: 0.111577 Sep 01 05:30:43.205381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 3/13] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:43.223458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bb1b6b19-3ad1-4aac-a853-4132e5833c18 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c74b430>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.790737 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bb1b6b19-3ad1-4aac-a853-4132e5833c18 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 202 len: 0 microversion: 2.1 time: 0.571666 Sep 01 05:30:43.791586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 11/14] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:30:43 2022] DELETE /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:30:43.800469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cd1f0fc3-69f3-40e8-b662-fe5875dc2f8c tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c83ee50>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.946436 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cd1f0fc3-69f3-40e8-b662-fe5875dc2f8c tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 200 len: 353 microversion: 2.1 time: 0.149996 Sep 01 05:30:43.952724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 4/15] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:44.960420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26bf71f7-b9f0-479f-9665-a906fd4bda69 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Calling method '.version_select at 0x7fbb6c74bca0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.015316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-26bf71f7-b9f0-479f-9665-a906fd4bda69 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] HTTP exception thrown: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26bf71f7-b9f0-479f-9665-a906fd4bda69 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Request method failure captured: Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 HTTP/1.1 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN_Epod7ci6mue4UyrEOY19O9A0DUR-hy4vgue58ctfkix089ITw_HFAlWkdkeo2oZM0oGvsuTbTQ937x36MRfo_Vwp-Bv558JwfhLPCrgokRYtVrOZfZN4c96HfbeE4RpkLwZxIvONygYzTOI-o0dMbFk4iNn8wPf3UwSd8rq25-E Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: cd8e91d7f43746a792603f48c8b76523 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesGetTestJSON-2133667570 Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:45.017435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd8e91d7f43746a792603f48c8b76523"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cd8e91d7f43746a792603f48c8b76523", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cd8e91d7f43746a792603f48c8b76523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cd8e91d7f43746a792603f48c8b76523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesGetTestJSON-2133667570 Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cd8e91d7f43746a792603f48c8b76523 Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesGetTestJSON-2133667570 Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesGetTestJSON-2133667570-project Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 6ed92ba22e824b198c5f86ac918dd3cf Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesGetTestJSON-2133667570-project Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '27ab8774-759a-4a3f-afab-1c97ea02a0d1'} Sep 01 05:30:45.018502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. (HTTP 404) (Request-ID: req-6957cb01-291a-4f38-ad81-cfc77190f71e) Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:45.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:45.020022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:30:45.020979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26bf71f7-b9f0-479f-9665-a906fd4bda69 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] Returning 404 to user: Volume 27ab8774-759a-4a3f-afab-1c97ea02a0d1 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26bf71f7-b9f0-479f-9665-a906fd4bda69 tempest-VolumesGetTestJSON-2133667570 tempest-VolumesGetTestJSON-2133667570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1" status: 404 len: 109 microversion: 2.1 time: 0.062735 Sep 01 05:30:45.021894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 12/16] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/os-volumes/27ab8774-759a-4a3f-afab-1c97ea02a0d1 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:45.495916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cb8259a5-07e7-4dd4-86f2-4a160e10fb4f tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c83eca0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.621804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cb8259a5-07e7-4dd4-86f2-4a160e10fb4f tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bd4ec292-272c-43a0-8074-aa3b9e6ea728" status: 200 len: 351 microversion: 2.1 time: 0.131307 Sep 01 05:30:45.630937 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 5/17] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/os-volumes/bd4ec292-272c-43a0-8074-aa3b9e6ea728 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:49.067022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4d41c11-626a-4b4e-bb52-b800a5ee2e9d tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c74b430>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.126924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c4d41c11-626a-4b4e-bb52-b800a5ee2e9d tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3125da40-fd17-4cdf-8b9e-df1baa0819c2" status: 200 len: 351 microversion: 2.1 time: 0.065059 Sep 01 05:30:49.137247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 13/18] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/os-volumes/3125da40-fd17-4cdf-8b9e-df1baa0819c2 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:49.145025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fffb898d-510d-4f55-bbdd-cdfe0057fe4f tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c83e5e0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.295245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fffb898d-510d-4f55-bbdd-cdfe0057fe4f tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.155681 Sep 01 05:30:49.296196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 6/19] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:49.317758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1962bd48-ff0c-45ed-9f97-c0d99d4ceb44 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c7add30>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.483543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1962bd48-ff0c-45ed-9f97-c0d99d4ceb44 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173228 Sep 01 05:30:49.484731 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 14/20] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:49.509178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bb831927-975a-4d9e-8ee2-b90d7bc8b321 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c847820>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.797736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bb831927-975a-4d9e-8ee2-b90d7bc8b321 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.298329 Sep 01 05:30:49.800774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 7/21] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:49.816955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-88717b52-7c64-449c-abbc-537d61172b78 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c818a60>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.000207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-88717b52-7c64-449c-abbc-537d61172b78 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189953 Sep 01 05:30:50.000583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 15/22] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:50.021238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6170ddaf-77bf-49be-af66-89cb0de56cff tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c847ca0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.205506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6170ddaf-77bf-49be-af66-89cb0de56cff tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.189282 Sep 01 05:30:50.216277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 8/23] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:50.225354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ef9fd2a2-77ab-4a2d-820c-1cfc7751f27a tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c74baf0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.404957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ef9fd2a2-77ab-4a2d-820c-1cfc7751f27a tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.185874 Sep 01 05:30:50.409904 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 16/24] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:50.421033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-76901c75-7de0-4034-a5ba-3c83687d1312 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c7c9160>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.632489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-76901c75-7de0-4034-a5ba-3c83687d1312 tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216595 Sep 01 05:30:50.633227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 9/25] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:50.649953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-73207fd5-5d5b-474b-9885-1f6fbe9e88ea tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] Calling method '.version_select at 0x7fbb6c7569d0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.906067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-73207fd5-5d5b-474b-9885-1f6fbe9e88ea tempest-VolumesTestJSON-1991609287 tempest-VolumesTestJSON-1991609287-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.259933 Sep 01 05:30:50.908211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 17/26] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.815307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a39e448e-dbe4-44e6-ae17-5e4aab093f03 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: .version_select at 0x7fbb6c7ce310>, body: {"keypair": {"name": "tempest-keypair-30138198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPLkSdLg5ER9aTL6II1skRxaXwboFwvCTBMrHQGRDr9ZayEp0TkU6oh3JaE3BAc+Pym+lqHZgvG2fmjwpXt4eHEwFwHtI+kpbv14VzCkByc/41z5cm4eZKyLzomqNT4PA=="}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:51.883304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-a39e448e-dbe4-44e6-ae17-5e4aab093f03 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for project 337817b568b64e98bc2bfd177e984351. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:51.907166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-a39e448e-dbe4-44e6-ae17-5e4aab093f03 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for user e9ad5076ef93462fbe614d7fc323935d and project 337817b568b64e98bc2bfd177e984351. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:52.291416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a39e448e-dbe4-44e6-ae17-5e4aab093f03 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.766351 Sep 01 05:30:52.299670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 10/27] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:30:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:54.050120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f27fa81a-7c02-4902-854b-ce4a619ec392 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: .version_select at 0x7fbb6c756280>, body: {"keypair": {"name": "tempest-keypair-299998657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXj67HNWNOiP/nFwDqoZL2p4cp+SIrmvznF/EDhmsIrkrhm9F6CKMBZwfKh/tht0ZfnbGQttlSLc2JI4XRkdK4bON5qylF01N1A3tvkS0ItX+9IkXvMIOyCB2FrGsMAtg=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:54.233870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f27fa81a-7c02-4902-854b-ce4a619ec392 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:54.238297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f27fa81a-7c02-4902-854b-ce4a619ec392 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:54.394366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f27fa81a-7c02-4902-854b-ce4a619ec392 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.984431 Sep 01 05:30:54.394975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 18/28] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:30:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:55.459617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1770158094", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "networks": [{"uuid": "d355c7f0-5b2b-4d2b-acd5-6c87fd25a81d"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:55.628734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] validate_networks() for [('d355c7f0-5b2b-4d2b-acd5-6c87fd25a81d', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:58.082991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-224368727", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a16813a5-5346-45d6-922a-cc80e1d12942"}], "security_groups": [{"name": "tempest-securitygroup--1707454539"}], "key_name": "tempest-keypair-30138198", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:58.366615 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:58.371901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:58.371901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:58.371901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:58.371901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:58.388275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.388770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.389200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.389982 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.390429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.390847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.446004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Getting quotas for project 9f237ba116b64751bee9817c19226b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:58.457354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Getting quotas for user e529f3610d114981a5a3d37bdf832dab and project 9f237ba116b64751bee9817c19226b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:58.485203 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:30:58.495233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:30:58.657391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] validate_networks() for [('a16813a5-5346-45d6-922a-cc80e1d12942', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:58.836335 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-00961d70-3359-40f9-9d59-fa0bf7228107 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.578317 Sep 01 05:30:58.836335 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 11/29] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:30:58.848005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2788c2d4-27a0-4705-9c5d-a75556d3f21f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:58.850981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2788c2d4-27a0-4705-9c5d-a75556d3f21f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:59.527328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2788c2d4-27a0-4705-9c5d-a75556d3f21f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:59.559724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2788c2d4-27a0-4705-9c5d-a75556d3f21f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1215 microversion: 2.1 time: 0.716693 Sep 01 05:30:59.562950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 12/30] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:58 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1215 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:00.554996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-764169245", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:00.672095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] validate_networks() for [('856c62ca-f5e7-40ea-ba7e-4517ff30bca8', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:01.553556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:01.560418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:01.560418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:01.560418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:01.560418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:01.580201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.580867 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.581403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.583954 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.585318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.587849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.683547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for project 337817b568b64e98bc2bfd177e984351. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:01.695577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for user e9ad5076ef93462fbe614d7fc323935d and project 337817b568b64e98bc2bfd177e984351. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:01.728770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:01.745228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:01.854131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:01.855136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:01.855956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:01.857415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:01.858068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:01.874785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.875527 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.876113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.877164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.877818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.879008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.960336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:01.966859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for user fb50b15e44814c6b82b2a75e3c74de0a and project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:02.005623 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:02.010075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:02.058514 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-87fd3291-8492-4e96-a5d3-0d716deb7def tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.982367 Sep 01 05:31:02.068383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 19/31] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 3993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:02.086751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.101587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.159292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.159799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.160241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.160957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.161403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.193680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.250521 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-57418ac7-58e7-459f-a9ce-1bbe9e5abc0f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.224032 Sep 01 05:31:02.252884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 13/32] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:02.316174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-775319779", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292c4ef4-bb7c-4583-ab02-5307a5a77a17"}], "security_groups": [{"name": "tempest-securitygroup--986271504"}], "key_name": "tempest-keypair-299998657", "user_data": "}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:02.631017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] validate_networks() for [('292c4ef4-bb7c-4583-ab02-5307a5a77a17', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:02.871272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.903579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8c7452cf-ac27-4202-99e9-abdcb3d20940 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1219 microversion: 2.1 time: 0.829265 Sep 01 05:31:02.903579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 20/33] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1219 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:02.907055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f207e07f-303d-4bcf-b058-79ac1b16a0cc tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.908567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f207e07f-303d-4bcf-b058-79ac1b16a0cc tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.980350 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f207e07f-303d-4bcf-b058-79ac1b16a0cc tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.021029 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f207e07f-303d-4bcf-b058-79ac1b16a0cc tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1235 microversion: 2.1 time: 0.118540 Sep 01 05:31:03.023063 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 21/34] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1235 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:03.033429 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1af1af1f-d39b-40b0-a11b-f1ef15dea2c8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:03.038253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1af1af1f-d39b-40b0-a11b-f1ef15dea2c8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:03.104562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1af1af1f-d39b-40b0-a11b-f1ef15dea2c8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.119145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1af1af1f-d39b-40b0-a11b-f1ef15dea2c8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1221 microversion: 2.1 time: 0.094808 Sep 01 05:31:03.119736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 22/35] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:03 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:03.374332 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-851322243", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:03.508308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] validate_networks() for [('856c62ca-f5e7-40ea-ba7e-4517ff30bca8', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:04.088598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:04.089155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:04.090626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:04.090626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:04.090812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:04.107738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.108305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.109007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.109782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.114310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.115273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.161564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:04.169299 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:04.186435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:04.189726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:04.314079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:04.314648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:04.314968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:04.315570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:04.316161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:04.329166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.329919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.330517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.331401 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.332075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.332817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.347714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6cd9fc5a-6704-40ae-9ccf-510a7cfb28bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.091288 Sep 01 05:31:04.350557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 14/36] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:04.371490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.378245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.403886 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.405442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.407173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.408137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.408500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:04.408976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.409885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.417217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for user fb50b15e44814c6b82b2a75e3c74de0a and project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:04.435606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:04.439476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:04.673484 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.690656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4a37f01a-56a6-4e2d-a0a0-4eb51abd0dc2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1267 microversion: 2.1 time: 0.334735 Sep 01 05:31:04.691408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 15/37] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1267 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:04.697238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2e1abda9-8252-434f-930b-a1fc86a50b14 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.697896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2e1abda9-8252-434f-930b-a1fc86a50b14 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.804920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f1e0123a-e8d4-426b-a6f0-cae74d68ca2c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.436473 Sep 01 05:31:04.810398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 23/38] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:04.835404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ef11daa9-6493-4173-af87-a482692a54db tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.836053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ef11daa9-6493-4173-af87-a482692a54db tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.913065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2e1abda9-8252-434f-930b-a1fc86a50b14 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.924157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2e1abda9-8252-434f-930b-a1fc86a50b14 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1235 microversion: 2.1 time: 0.231169 Sep 01 05:31:04.925716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 16/39] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1235 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:04.937687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fb58a842-aa98-44a6-bc8c-913d2d9351f3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.938537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fb58a842-aa98-44a6-bc8c-913d2d9351f3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.171972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ef11daa9-6493-4173-af87-a482692a54db tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.187025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ef11daa9-6493-4173-af87-a482692a54db tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1240 microversion: 2.1 time: 0.371655 Sep 01 05:31:05.210950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 24/40] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1240 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:05.335253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb58a842-aa98-44a6-bc8c-913d2d9351f3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.346138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fb58a842-aa98-44a6-bc8c-913d2d9351f3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1221 microversion: 2.1 time: 0.418786 Sep 01 05:31:05.347429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 17/41] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1221 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:05.734269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:05.735530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.745449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.746137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.746709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.747607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.750040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.750648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.939037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.946499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8664e7b6-b833-45dd-80cc-f7c8c69826ed tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:05.949804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8664e7b6-b833-45dd-80cc-f7c8c69826ed tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.975224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7a39c604-649f-462c-a566-20b5f9de57fb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1285 microversion: 2.1 time: 0.255322 Sep 01 05:31:05.980065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 25/42] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:05 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:06.093105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8664e7b6-b833-45dd-80cc-f7c8c69826ed tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.096857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8664e7b6-b833-45dd-80cc-f7c8c69826ed tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1235 microversion: 2.1 time: 0.154871 Sep 01 05:31:06.099213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 18/43] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:05 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1235 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:06.210978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e085e7c-e357-491c-96db-4f41a1fa60bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.211643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e085e7c-e357-491c-96db-4f41a1fa60bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.369341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b01b85fb-b79c-4dbd-9027-6f0bf60dee71 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.370026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b01b85fb-b79c-4dbd-9027-6f0bf60dee71 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.416090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e085e7c-e357-491c-96db-4f41a1fa60bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.429014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e085e7c-e357-491c-96db-4f41a1fa60bb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1240 microversion: 2.1 time: 0.224676 Sep 01 05:31:06.430176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 26/44] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1240 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:06.538879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b01b85fb-b79c-4dbd-9027-6f0bf60dee71 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.551589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b01b85fb-b79c-4dbd-9027-6f0bf60dee71 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1221 microversion: 2.1 time: 0.184861 Sep 01 05:31:06.569398 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 19/45] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:07.008151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.009571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.026417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.027882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.031061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.032167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.033049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.033665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.120253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.121371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.129686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.130641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.131680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.133324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.136126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.136892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.175411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:07.188971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-67d7dc52-460f-4514-92aa-c06fa7d210bc tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1273 microversion: 2.1 time: 0.182248 Sep 01 05:31:07.203566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 27/46] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:07.343720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:07.356815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-72568a23-a607-42de-a757-03ca066fa431 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1231 microversion: 2.1 time: 0.241302 Sep 01 05:31:07.357699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1231 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:07.453955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.454765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.492579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.493196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.494049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.494994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.502325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.502772 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.576039 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.577691 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.614237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.614745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.619738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.624941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.626348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.628206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.022939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.041322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6e36de0c-5cf5-4a8c-a075-62fd618f1b5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1236 microversion: 2.1 time: 0.592806 Sep 01 05:31:08.043018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 28/48] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1236 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:08.079429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.090168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2f176e9a-02d4-4ddd-a7d2-4caf11500f54 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1217 microversion: 2.1 time: 0.518501 Sep 01 05:31:08.093225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 21/49] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1217 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:08.217736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:08.219392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:08.228523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.229548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.230181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.231095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.231777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.232443 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.385900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:08.386690 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:08.420237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.422679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.424997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.430552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.439273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.439273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.814271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.838056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5a75087d-6eee-4764-b5c1-962d21df779e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1287 microversion: 2.1 time: 0.456373 Sep 01 05:31:08.842018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:08 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1287 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:09.067393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.068243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.112946 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.120136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.127831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.129320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.133373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.135343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.309367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.339291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-01dbe18d-9fde-4463-bd05-dc24aba4135d tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 1.127145 Sep 01 05:31:09.348058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 29/51] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:08 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:09.388380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.393176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.426431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.428010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.430311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.432150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.436901 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.439162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.570079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.595426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-232339f8-1edc-49b0-bfd7-fa56b1990f61 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1292 microversion: 2.1 time: 0.535190 Sep 01 05:31:09.599936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 23/52] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1292 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:09.862548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.864169 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.870641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.871351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.871969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.872822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.873830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.874503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.914497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.926384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ecae7406-1e0a-415e-a2c9-15bae8dac9a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1273 microversion: 2.1 time: 0.576727 Sep 01 05:31:09.937645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 30/53] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1273 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:10.167828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.178505 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-79af5802-d758-4786-b6c6-47cec8f87c8b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1293 microversion: 2.1 time: 0.319757 Sep 01 05:31:10.179291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 24/54] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1293 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:10.378229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.383336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.481079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.485928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.485928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.495081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.504355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.506124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.625384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.626409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.650470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.651080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.651498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.654009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.656686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.657263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.242515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.275034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fcf60a97-93f6-480b-bf53-c9ecb6e868ac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1310 microversion: 2.1 time: 0.645581 Sep 01 05:31:11.278244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 25/55] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1310 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:11.325445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.326197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.345126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.346590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.353773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.357451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.359279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.372013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.541001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.560035 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-76fe5061-a1c6-4cd2-94b1-621978fe3afd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1291 microversion: 2.1 time: 0.276734 Sep 01 05:31:11.574174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 26/56] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:11 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1291 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:11.581080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.581727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.599176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:11.599176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.599176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.606470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.607643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.609944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.610583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.652267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.664965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-684960af-5016-4710-bcb7-2e96edb42363 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 1.294630 Sep 01 05:31:11.666289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 31/57] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:11.814464 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.832340 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c714dcb6-36a7-4f80-b5f1-e4eba22b59d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1293 microversion: 2.1 time: 0.269760 Sep 01 05:31:11.835303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 27/58] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:11 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:12.299808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.300610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.308932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.309950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.311355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.312226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.312827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.313496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.486238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2727d2ef-de94-4553-9ce1-ec70f0a67f46", "tag": "3c31cd04-d4d8-4de9-a16a-af5c1528b81b"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:12.508397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.509043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.509692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.534289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Creating event network-changed:3c31cd04-d4d8-4de9-a16a-af5c1528b81b for instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 on hv-cinder-85220 Sep 01 05:31:12.536079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:31:12.536642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0113a6da-297f-48c4-ba3f-eacdf1cada3d req-a05b039b-26d9-458d-80d5-4ccc9d051ac4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:31:12.538016 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.538658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.539490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.540434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.541094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.542233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.554783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.compute.rpcapi [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:31:12.559065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] Releasing lock "compute-rpcapi-router" {{(pid=121033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:31:12.563991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.581367 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cd9d8765-a8a4-4ad7-a30f-24d760194eb0 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212729 Sep 01 05:31:12.582887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 28/59] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:12.586632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ee1e61be-a878-4876-8732-b39ce24fe39d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1298 microversion: 2.1 time: 0.290782 Sep 01 05:31:12.590157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 32/60] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1298 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:12.632557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.633803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.655972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.656631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.657538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.658322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.658900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.659377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.707419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.713432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.721857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.722544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.723346 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.731290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.732062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.733390 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.943969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.959324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8b274a1d-b676-40e5-a31f-97f79b68f794 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1279 microversion: 2.1 time: 0.373321 Sep 01 05:31:12.962090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 29/61] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:12.976956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.976956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.991934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.992428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.995681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.999024 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.999720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.005744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.411156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.441835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7eaf0c9e-eb03-40a3-b484-61184a6a1630 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.728600 Sep 01 05:31:13.441835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 33/62] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:13.451736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.461680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b5a01f46-33cd-438c-b966-54752619d254 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1293 microversion: 2.1 time: 0.496684 Sep 01 05:31:13.469575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1293 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:13.616234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.616956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:13.625075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.625718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.626202 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.627185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.627873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.628790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.991033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.992256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:14.008342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.010118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.012540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.015612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.016286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.018559 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.363906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:14.868594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.880576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-caedd090-8dd1-4398-81cd-5dbf7ca324c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1279 microversion: 2.1 time: 0.897110 Sep 01 05:31:14.895529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 31/64] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1279 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:14.901545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:14.902492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:14.910564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.911472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.912067 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.912902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.913675 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.914225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.983489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.995255 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0fdd919b-7e3e-4c60-a598-5985b4054596 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 1.383159 Sep 01 05:31:14.995882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:15.002190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.002985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.062928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.069683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.070094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.070836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.071286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.071703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.739930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.768015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d62a382e-ebdc-4bf3-8686-a123bc781344 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.868711 Sep 01 05:31:15.786525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 32/66] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:14 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:15.903347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.903961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.919269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.920013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.920637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.921526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.922124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.922694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.972859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.006664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-915fb216-b860-4eb2-a7eb-b60a41ff61e7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 1.003661 Sep 01 05:31:16.011112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 35/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:14 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:16.035424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:16.049547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:16.077157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.077931 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.079825 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.086083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.087123 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.087785 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.417593 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=24 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:16.550007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=32 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:16.703781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.713025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3482bfa0-622a-407f-8515-e6418d197b9e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.813119 Sep 01 05:31:16.718233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 33/68] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:15 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:16.752998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bedbeaf-c165-4774-b947-dd14b08dcb67", "tag": "4163992e-a815-4b35-a6b7-0bc2d7c7b1c1"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:16.771020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.774940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.775358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.777434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.785634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c2da2784-72bf-4f9b-b8ad-79e3ebfa29d4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.761211 Sep 01 05:31:16.787640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:16 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:16.809187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:16.810412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:16.819043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] Creating event network-changed:4163992e-a815-4b35-a6b7-0bc2d7c7b1c1 for instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 on hv-cinder-85220 Sep 01 05:31:16.821046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.824139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-6e2ee42d-9601-44d5-be34-a1e61123561b req-ab4a75cc-f26b-4885-bd5e-92ac946cf03c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104481 Sep 01 05:31:16.824601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.825105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 34/70] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:16.826997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.828037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.828606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.830020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.037828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.040802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.066943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.070773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.072443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.074991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.077782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.079099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.156503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:17.641942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.656557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9b1843e7-eba8-407a-aec9-0e8172ecf005 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.851506 Sep 01 05:31:17.658251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 37/71] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:16 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:17.743961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.750405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.764579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.765580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.766552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.767442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.768067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.768584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.125350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.161387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f0990ae1-c930-4139-acb0-2c4997d46c11 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 1.131124 Sep 01 05:31:18.164625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 35/72] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:18.183019 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.183889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:18.198853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.199686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.200438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.201953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.205093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.205093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.218544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.227796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-38a34ac5-f2f9-45fb-9278-486ec782f615 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.490245 Sep 01 05:31:18.234591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 38/73] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:18.681412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.683074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:18.697985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.701957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.704865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.707648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.711091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.711885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.255005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.268157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-faa1f22e-ff6d-411c-a39d-66f319b2c2ef tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 1.099902 Sep 01 05:31:19.269423 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 36/74] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:19.315141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.325584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6d86cabb-5218-4602-9745-2705600d3738 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.648882 Sep 01 05:31:19.343321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:19.349048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:19.351537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.359028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:19.360736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.361416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.362090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.363006 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.363668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.364291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.505930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f0b2a5-67bc-4a0b-a725-16a3c66c472d", "tag": "9c9d109d-5428-4c12-b14a-04e96ba61b6f"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:19.526804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.527731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.530052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.555905 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] Creating event network-changed:9c9d109d-5428-4c12-b14a-04e96ba61b6f for instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d on hv-cinder-85220 Sep 01 05:31:19.563624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-bdf2a2df-64da-402e-b411-a229fba30562 req-cedb895b-0248-44cc-a0fd-53ed350b8016 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292045 Sep 01 05:31:19.564841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 37/76] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:19.570450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:19.572400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.580964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.581873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.582561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.583820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.584445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.585150 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.773760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.781282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:19.800709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-42386309-bcd6-4161-82e9-5f321200badf tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.454339 Sep 01 05:31:19.806362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 40/77] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:19 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:20.101570 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.112430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-db41bc68-6f29-4046-97fb-874ae8fbda0b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.545702 Sep 01 05:31:20.117154 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 38/78] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:19 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:20.296783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.305657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.331351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.337519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.337519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.338428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.339689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.342409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.349339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.350705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.364512 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.365327 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.366021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.366985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.370516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.371371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.947790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.953141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.967903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b246cc6e-9ad4-4217-94d2-07eff9122b34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.680892 Sep 01 05:31:20.969863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 41/79] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:20.979261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4c4c9097-c961-40e3-974a-85c2c5acaaca tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.633550 Sep 01 05:31:20.983760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:20.988700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.989562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.008148 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.010290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.010700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.011398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.011842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.012258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.137891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.138563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.151130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.152089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.152786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.154456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.155188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.159799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.586796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.599040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-95331d8a-809a-4a32-9f8f-5b36e493fb9a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.627506 Sep 01 05:31:21.599633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 42/81] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:21.612816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed02a46-8470-424b-a900-23405ff45d0c", "tag": "518d51c5-0ec9-4de4-971a-46ed87c7ba5b"}, {"name": "network-changed", "server_uuid": "7daf7696-f2c7-4c63-b929-03cc743b8ea2", "tag": "d484bf56-8ee3-4920-858a-0b66b9e65df5"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:21.641673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.642140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.642758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.643204 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.656620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-14b902fa-2dba-4bfa-bdf2-a0a57427842c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.523235 Sep 01 05:31:21.657812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 40/82] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:21.682109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Creating event network-changed:518d51c5-0ec9-4de4-971a-46ed87c7ba5b for instance 9ed02a46-8470-424b-a900-23405ff45d0c on hv-cinder-85220 Sep 01 05:31:21.682785 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Creating event network-changed:d484bf56-8ee3-4920-858a-0b66b9e65df5 for instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 on hv-cinder-85220 Sep 01 05:31:21.683452 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:31:21.683969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8982f2f4-8129-4a0e-8125-a47b7df52b77 req-7b64544e-3781-4f4b-a40b-09e69414cab1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:31:21.686353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.686953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.687656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.688804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.689416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.690005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.701728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.compute.rpcapi [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:31:21.703072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] Releasing lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:31:21.729642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3b00ceac-1da2-4120-a1a7-3ce19edeba99 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120111 Sep 01 05:31:21.731502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 43/83] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:31:21.992010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.992622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.999432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.000148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.000579 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.001266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.002914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.002914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.009441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.010928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.018359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.018923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.020407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.020407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.020610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.020992 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.205209 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.215290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5168bac0-146a-4b09-99b4-3fa2d844cf75 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.229358 Sep 01 05:31:22.216573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 41/84] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:22.229661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.236379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-27a0e99b-4e8e-4df5-a6cd-f9412b837d78 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.231442 Sep 01 05:31:22.236853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 44/85] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:22.621219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.621843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.623822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=8 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:22.628510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.628972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.629393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.630116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.630565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.630966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.678498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.679102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.686075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.686577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.687128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.687752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.688193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.688605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.829290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.844353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9a05a3bd-a14e-4a60-a08c-7003d4d2c51c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.226824 Sep 01 05:31:22.845107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:22.866298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.882676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6518d710-dcb8-4751-826e-26b0ba70c24e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.207701 Sep 01 05:31:22.884274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 45/87] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:23.238933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.240399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.263637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.264358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.266488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.266855 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.267286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.268283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.268418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.268837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.271891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.272454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.272902 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.274604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.274604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.274921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.483272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.487796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.491914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b7fc824f-08e5-4b40-816d-318629a7bcc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.232630 Sep 01 05:31:23.492704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 46/88] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:23.495738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-45919b8b-9ef9-49f2-8557-a982eb153354 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.262778 Sep 01 05:31:23.496454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:23.880379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.880977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.887154 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.887617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.888598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.889494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.889969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.890382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.908943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.909493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.915397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.915875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.916300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.916999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.917504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.917924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.093011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.098687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.101775 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9ef19b36-78d3-4941-bb7b-3a798344d6ef tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.225225 Sep 01 05:31:24.105683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:24.108795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e4ba1ee0-d10d-448f-87aa-54e43416ba47 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.203677 Sep 01 05:31:24.109823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 44/91] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:24.513337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:24.514039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.516010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:24.516636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.520676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.521525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.521653 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.522294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.525583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.525583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.525751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.525751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.525751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.525751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.526071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.526071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.738088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.741186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.746570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c939bafe-a0aa-45b5-a2d2-fba2456566ce tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.237046 Sep 01 05:31:24.747136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 48/92] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:24 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:24.749666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e6541b37-11f2-4a15-bcc7-fd58c498120d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.237573 Sep 01 05:31:24.750299 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 45/93] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:24 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:25.123804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.124627 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.129300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.129947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.130623 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.131097 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.131517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.132187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.132633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.133036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.135839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.136388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.136822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.137517 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.138619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.139033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.514216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.520785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.522697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-29f69015-6d79-474c-92dc-15e36a170658 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.403313 Sep 01 05:31:25.523361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 49/94] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:25.536435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-217572b9-8dd1-4ab3-a870-3c142a7750bc tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.410795 Sep 01 05:31:25.537416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 46/95] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:25.767120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.767798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.774016 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.774317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.774745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.775415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.775538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.775931 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.776176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.776381 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.782931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.783405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.783983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.784578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.785011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.785420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.974416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.983284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a46839e2-89e2-4bc4-99e0-d2e2a36eb614 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.219856 Sep 01 05:31:25.984160 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.984316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 50/96] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:25.992905 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-948cddb4-aff3-4454-89a5-7f436ef3ff74 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.221162 Sep 01 05:31:26.005513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 47/97] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:26.543189 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.543790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.550756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.551226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.551649 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.552319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.552756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.553163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.558953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.564520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.566082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.566567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.566996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.567682 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.568128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.568544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.004847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.014400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-966e7d21-54f0-42db-a591-40d11e490bb6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.474653 Sep 01 05:31:27.014987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 51/98] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:27.024898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.025060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:27.025060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:27.031735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-65a2a5c5-d200-4ea3-9e6f-523797e8d799 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.476642 Sep 01 05:31:27.031945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.032447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.032557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:27.033105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.034094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.034667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.035238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.038336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:27.040947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:27.047933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.053493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.053493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.053493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.053493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.053866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.312431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.316380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.320896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b7e4a960-3ce1-4052-97dd-cac54c1597e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.287312 Sep 01 05:31:27.321494 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 49/100] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:27 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:27.326468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-901dc8f1-1189-4f35-8c7d-54c00bbbfe09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.310272 Sep 01 05:31:27.327351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:27 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:28.035882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.036436 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.043252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.043773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.045036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.045811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.046278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.046699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.053895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.056991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.062451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.062947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.063383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.064363 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.064747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.065357 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.244964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.257541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7306a167-2c20-4bc4-9dcc-0ffc87f1197d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.225451 Sep 01 05:31:28.258652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:28.277701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.285697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b3942b76-907b-4c9f-a451-50a350e00951 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.236271 Sep 01 05:31:28.286323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 53/103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:28.342443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.343052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.347861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.348464 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.349243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.349753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.350177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.350861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.351304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.351724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.354637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.355108 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.355537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.356211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.357256 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.357698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.561644 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.565490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.569470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bdba3146-9cac-44d5-afe9-dc701f3ec84c tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.225379 Sep 01 05:31:28.570050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 54/104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:28.573188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-add5fb2e-2fcc-4bad-bb9b-bad173acee29 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.234811 Sep 01 05:31:28.573782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 51/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:29.279761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:29.280362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:29.286446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.286925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.287352 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.288028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.288471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.288906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.306400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:29.307792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:29.314732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.315216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.315641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.316325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.316816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.317227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.491081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.495785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.499090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7bcebeaa-a94f-4f79-94e2-6e62ef37e008 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.223372 Sep 01 05:31:29.499515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:29.499697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 55/106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:29 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:29.504289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9f984449-b4a7-481f-b2e4-bac51b8cbc43 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.201696 Sep 01 05:31:29.504857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 52/107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:29 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:29.594402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:29.594618 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:29.594999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:29.595107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:29.601030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.601338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.601539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.601836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.601952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.602260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.602635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.602930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.603067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.603551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.603663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.604015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.825962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.833678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.833864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dba62b4d-a2a3-435e-9be2-ed8fb0fb6deb tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.243322 Sep 01 05:31:29.834397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 56/108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:29 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:29.842833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f273faf-c4c4-43db-8895-eead0120c288 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.252448 Sep 01 05:31:29.843414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 53/109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:29 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:30.519652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.520345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.524996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.525660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.526519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.526995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.527453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.528756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.529297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.529834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.532179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.532654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.533079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.533780 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.534229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.534672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.726747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.735607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.736015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:30.739593 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-360b53d0-5300-40e3-9d1b-ea07473671fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.223933 Sep 01 05:31:30.740257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 57/110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:30.747288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b3a9cf33-6fe2-45e5-99de-e858cef5ff05 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.226062 Sep 01 05:31:30.748065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 54/111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:30.855651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.856283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.862451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.862952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.863384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.864061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.864507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.864604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.864919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.867818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.874471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.874951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.875402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.876168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.876611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.877024 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.072890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.077614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.081369 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d78d331f-460d-4c67-a47f-86b0a34edac1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.220758 Sep 01 05:31:31.081975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 55/112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:31.085545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b57a32de-adab-4619-92c8-ec78b35f35a7 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.233678 Sep 01 05:31:31.086226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 58/113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:31.761943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:31.762693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:31.767101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:31.767710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:31.769619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.769920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:31.770092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.770545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.771217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.771654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.772059 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.775204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.776191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.776191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.776794 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.777860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.777860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.129614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.137365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c1dc63fe-6599-4360-a9ff-cf2b90e72499 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.374007 Sep 01 05:31:32.138065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 59/114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:31 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:32.141988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.142605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:32.143198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:32.149081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.149587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.149764 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2551f9e1-ac72-479c-967d-d41c98a97c82 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.393383 Sep 01 05:31:32.149999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.150748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.150861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:31 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:32.151182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.151771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.155611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:32.156276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:32.162397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.162879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.163303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.163992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.164440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.164856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.343592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.351214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e2ee7e4-7dad-4207-96f6-2b59f2bf9090 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.212090 Sep 01 05:31:32.351776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:32 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:32.354929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.363308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cebd8d87-5b9f-4715-a802-078ebae21a71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.211413 Sep 01 05:31:32.363956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:32 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:33.158605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.159194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.165303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.165816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.166233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.166900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.167336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.167740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.170269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.174658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.176963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.177444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.177907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.178592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.179037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.179460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.366731 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.369988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.375339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b891d34-5d35-49f7-8c92-8dbb0981b002 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.221104 Sep 01 05:31:33.376249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 61/118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:33.378416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6b77f11c-ad1d-431d-812e-0f2732fb442b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.212027 Sep 01 05:31:33.379283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:33.380441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.381044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.388357 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.388928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.389450 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.390158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.390349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.390601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.391012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.391109 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.396941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.397411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.397874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.398544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.398982 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.399388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.584832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.588110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.592647 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e11cf79e-a2be-4323-964f-21ead2fec721 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.215772 Sep 01 05:31:33.593300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 62/120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:33.596063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c9439206-f4b8-467d-bde3-af5270bf19a9 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.210948 Sep 01 05:31:33.596622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:34.396107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.396738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.399706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.400309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.404598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.405069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.405508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.406180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.406455 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.406615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.406931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.407024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.407387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.408038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.408485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.408902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.601210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.605079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.609389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3088092-e186-4b02-b4d2-17c53db246e9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.217061 Sep 01 05:31:34.609987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 63/122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:34.613356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-efb31ca9-9b5f-4c31-92aa-7c2b5ebe9ae7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.217119 Sep 01 05:31:34.614307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:34.614609 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.615414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.619328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.619925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.622157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.623010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.623500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.624245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.624747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.625376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.626273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.626746 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.627201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.627907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.628344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.628755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.821592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.824463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.830306 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4a73aee9-27b2-4d2d-9da0-11f177a21ba3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.219350 Sep 01 05:31:34.831057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 64/124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:34.832960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c64ce069-8d50-4cae-b1fa-9874120152a1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.217384 Sep 01 05:31:34.833553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 61/125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:35.630415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:35.631007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:35.633773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:35.634403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:35.637170 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.637709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.638243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.638943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.639378 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.639834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.640671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.641153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.641611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.642292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.642734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.643177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.831440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.834636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.839065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b03f850-57d4-463f-974c-4c96d8a3a9ca tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.212722 Sep 01 05:31:35.839621 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 65/126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:35 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:35.843797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-61c597a2-55e0-4dfe-8cbb-3e0cd960ee83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.213940 Sep 01 05:31:35.844351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:35 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:35.853208 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:35.853208 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:35.853479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:35.854068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:35.857437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.857952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.858377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.859053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.859496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.859938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.860734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.861224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.861694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.862418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.862869 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.863289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.052510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:36.058585 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:36.061841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-303e3214-4979-49b6-ae8b-81920c398a64 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.214609 Sep 01 05:31:36.062736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:35 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:36.066978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4094e575-25ff-44a2-b217-bb59ede9ab60 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.217352 Sep 01 05:31:36.067714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:35 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:36.861061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:36.861776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:36.864582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:36.865190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:36.867821 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.868303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.868730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.869407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.869983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.870300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.871075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.871549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.872055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.872655 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.873100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.873543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.062476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.065538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.070377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e4e48a8a-6bc6-483f-8a0d-6c04ba2e48f2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.213179 Sep 01 05:31:37.070944 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:36 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:37.073106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-050db062-45ea-4a9f-9779-0d2f0c6f6005 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.212344 Sep 01 05:31:37.073689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 64/131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:36 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:37.081968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:37.082946 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:37.087999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:37.088623 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:37.089301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.089806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.090322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.091817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.092308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.092738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.095129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.095607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.096037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.096743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.097183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.097641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.301114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.308706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.309479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b2191f31-9f29-4ea6-9242-e00a668354c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.230613 Sep 01 05:31:37.310187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:37 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:37.316710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-30160027-59d8-40fa-9fcb-6837ead11b1b tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.232376 Sep 01 05:31:37.317509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:37 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:38.091725 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.092494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.093565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.094176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.098569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.099045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.103572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.103681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.103774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.103877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.103980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.103980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.104164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.104164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.104164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.104164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.304947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.310393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.314369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4910779a-32c9-478c-9cff-4343c811b667 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.227179 Sep 01 05:31:38.318650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b37a78fe-ad4e-454a-8ad3-46a75cecbb74 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.229592 Sep 01 05:31:38.319257 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 66/134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:38.321888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 69/135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:38.332803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.333645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.339710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.344158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.344158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.344158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.344158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.344541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.344629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.344629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.350104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.350714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.351216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.351987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.352505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.352983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.555804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.558747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.564704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-293279e1-c733-47e2-bb69-a1707db62cb5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.235520 Sep 01 05:31:38.568291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:38.568406 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f8c9eccb-c612-440f-9f89-7ab82558cb59 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.233395 Sep 01 05:31:38.569233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:39.335532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.336743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.339627 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.340264 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.344507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.345000 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.345448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.346309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.346408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.346767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.346928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.347193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.347577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.348269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.350287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.350858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.572553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.588678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ceeb7370-464c-466c-b3cc-4c53e1586489 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.256851 Sep 01 05:31:39.590310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 68/138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:39.596072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.597711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.605407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.606985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.608042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.611840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.613211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.613925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.614895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.616395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f889b5f2-2ec2-4e4a-8acf-07212de12713 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.280592 Sep 01 05:31:39.617528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:39.623188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.623963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.630472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.631815 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.632410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.633286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.633905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.634471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.653924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:39.861708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.869956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-867df980-e694-4ca9-9a95-8665e7765609 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.278523 Sep 01 05:31:39.874178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:39.877538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.886321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c543c9a2-ed23-48c2-9851-916ae5b25d71 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.267560 Sep 01 05:31:39.897958 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 72/141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:40.611928 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.612532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:40.618734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.619210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.619631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.620308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.620749 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.621161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.652497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.653921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:40.660208 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.660610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.661032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.661729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.662216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.662622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.814619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:40.826372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-26ce4a33-7b33-47f5-86de-aa4714f0bf75 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.218189 Sep 01 05:31:40.838273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 70/142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:40.841994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:40.849712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5277a281-aff1-47a9-a8d9-328772f56630 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.201541 Sep 01 05:31:40.852054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 73/143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:40.894186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.894786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:40.900683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.901147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.901604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.902275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.902710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.904022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.910393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.911208 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:40.917216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.917974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.919375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.920584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.921380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.922151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.942271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:41.101240 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.109633 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1a00b45a-3cbf-4a89-830c-c73964f6535a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.219238 Sep 01 05:31:41.110566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 71/144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:41.112725 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.120404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ed820434-4fd4-4a3b-b40f-7f3ef59af2af tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.214027 Sep 01 05:31:41.120942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 74/145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:41.847297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:41.847904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:41.853919 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.854395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.854824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.855498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.856036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.856469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.870898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:41.871774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:41.878024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.878498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.878914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.879585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.880024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.880426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.039894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.048023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d81ca1a5-0c7b-49ad-8fe7-817ce11cf592 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.204526 Sep 01 05:31:42.048594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 72/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:41 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:42.061986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.069863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ebbdad40-e422-49a9-bf02-dc9bbd7961af tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.202776 Sep 01 05:31:42.070417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 75/147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:41 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:42.130366 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:42.130962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:42.136786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.137844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.138314 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.138991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.139427 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.139833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.142278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:42.142879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:42.148645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.149108 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.149559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.150282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.150719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.151124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.330910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.337703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.338579 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1f1703c7-fc79-48a8-9319-6f945dbf6dac tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.212014 Sep 01 05:31:42.339144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 73/148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:42 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:42.346656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f10a9dcc-4a2d-464e-b3df-e6f009c828ef tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.209170 Sep 01 05:31:42.347216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 76/149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:42 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:43.067894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:43.068507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:43.074435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.074972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.075433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.076109 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.076555 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.076971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.092828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:43.093430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:43.099383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.099863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.100286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.100999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.101439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.101875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.280895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.287948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.288580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fb628cde-02ba-4e12-a578-fa99c24515ec tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.224419 Sep 01 05:31:43.289143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 74/150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:43 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:43.295836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26003351-7742-46c4-a2ae-b16e451e564e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.207568 Sep 01 05:31:43.296392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 77/151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:43 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:43.359293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:43.359899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:43.366156 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.366636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.367063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.367722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:43.367833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.368166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.368325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:43.368577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.374196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.374672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.375095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.375765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.376204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.376617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.563548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.566470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.571439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a27658bd-18f0-477a-b5b0-942cc4950357 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.215988 Sep 01 05:31:43.572110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 75/152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:43 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:43.574054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-279c5bfc-d0ff-4da4-965d-032f17b848ac tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.209991 Sep 01 05:31:43.574675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 78/153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:43 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:44.309278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.309816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.311715 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=97 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:44.315316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.315912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.316397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.316877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.317304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.318012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.318482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.323453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.323572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.323572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.323572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.323572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.323887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.324175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.676141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.680718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.684921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8e3ad89c-666a-47c1-a303-0c91c2b73167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.378977 Sep 01 05:31:44.685507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 76/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:44.690425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-df37371e-2121-494d-b899-463f61a7493e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.378649 Sep 01 05:31:44.690920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.691713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.698571 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.699051 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.700041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.700743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.701183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.701695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.705049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 79/155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:44.710211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.710817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.718251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.718251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.718635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.719318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.719927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.720341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.905645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.908911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.913501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3b0bcf60-0406-4965-996d-9fa59a4422a5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.226801 Sep 01 05:31:44.914079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 77/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:44.916632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c22d9763-b31e-47a1-b2ce-291792d3f7f2 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.210294 Sep 01 05:31:44.917183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 80/157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:45.706893 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:45.707503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:45.711912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:45.712528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:45.714168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.714830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.716070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.717333 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.718488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.718488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.720283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.720765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.721190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.721945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.722387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.722809 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.924647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:45.928485 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:45.934811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cb17f829-e239-42b1-92de-41ca2d49caea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.231946 Sep 01 05:31:45.935470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 78/158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:45 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:45.937475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f27450f3-9916-4f1c-bba9-f7ac5012f38f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.229414 Sep 01 05:31:45.938283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 81/159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:45 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:45.939800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:45.940391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:45.946222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.946695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.947114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.947776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.948208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.948640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.954976 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:45.955580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:45.961479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.961943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.962358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.963035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.963475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.963886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:46.146572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:46.155297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2c4511c1-75b4-48e4-b16b-ce8292eae7e1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.218930 Sep 01 05:31:46.155972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 79/160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:45 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:46.171184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:46.179063 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0b3e5b02-3814-4ed2-b486-27d3ef41ba8f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.228450 Sep 01 05:31:46.179634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 82/161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:45 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:46.956804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:46.957564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:46.961240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:46.961999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:46.963757 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.964243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.964731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:46.965899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.966372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.966802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:46.969381 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.969931 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.970356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:46.971040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.971475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.971906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.169780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.178009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-89f43b3c-d175-41d1-8180-d01cdd72b7c0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.220400 Sep 01 05:31:47.191937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:46 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:47.197227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:47.201921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:47.205325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.206004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.206581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.207538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.208148 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.208749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.212310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.221105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bf74dfb6-0011-4bf2-a916-6b6904ca7cce tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.268344 Sep 01 05:31:47.222350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:46 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:47.238080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:47.238080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:47.245367 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.246287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.246944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.249848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.249848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.249848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.445770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.447819 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.455010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c922e058-8448-4f75-919b-54dae4d6ceae tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.261205 Sep 01 05:31:47.456182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:47 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:47.458248 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7395d9c7-7815-46ab-8ab7-21c9fae602d3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.234253 Sep 01 05:31:47.459015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:47 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:47.790584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2727d2ef-de94-4553-9ce1-ec70f0a67f46", "name": "network-vif-plugged", "status": "completed", "tag": "3c31cd04-d4d8-4de9-a16a-af5c1528b81b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:47.804588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.805318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.805932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.819029 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] Creating event network-vif-plugged:3c31cd04-d4d8-4de9-a16a-af5c1528b81b for instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 on hv-cinder-85220 Sep 01 05:31:47.824022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d5656d2f-70ff-467a-9b2a-0e136ba2eafc req-3050dcd0-b91b-4f89-b64a-a87a31d4bc7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216013 Sep 01 05:31:47.824869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 85/166] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:48.198663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.200164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.207003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.207744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.208381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.209391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.210164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.210794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.245687 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.247151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.254526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.255307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.255978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.257033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.257864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.258284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.460204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.467090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.477115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8409d655-efcb-42c9-b410-328096670051 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.235584 Sep 01 05:31:48.477811 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 86/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:48.481658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bafbff04-b450-4bb3-b718-b3da15d0e787 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.283626 Sep 01 05:31:48.482748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 82/168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:48.493377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.494563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.495566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.495817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.516878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.516878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.516878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.516878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.517397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.517397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.518631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.518631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.518631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.519677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.520136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.520712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.970207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.977836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3224d70b-b4ac-422b-9318-a83287835bbc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.498805 Sep 01 05:31:48.988515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.994575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 87/169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:49.005516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-44cc43f7-6fba-4fcd-a996-4cd61efea887 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.521528 Sep 01 05:31:49.009014 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 83/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:49.501449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:49.502078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:49.508827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:49.509319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.509622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.510050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.510842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.510968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:49.512117 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.512963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.521698 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.522792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.523441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.524454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.525020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.525683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.728012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.736139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-031605c3-75e2-4edd-9dd0-adb9a579226c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.238336 Sep 01 05:31:49.736718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 88/171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:49 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:49.758744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.768101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8bbdc009-6658-4681-9ee9-7d5c58a22256 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.264442 Sep 01 05:31:49.768827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 84/172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:49 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:49.838498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed02a46-8470-424b-a900-23405ff45d0c", "name": "network-vif-plugged", "status": "completed", "tag": "518d51c5-0ec9-4de4-971a-46ed87c7ba5b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:49.848904 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.849385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.849839 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.861228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] Creating event network-vif-plugged:518d51c5-0ec9-4de4-971a-46ed87c7ba5b for instance 9ed02a46-8470-424b-a900-23405ff45d0c on hv-cinder-85220 Sep 01 05:31:49.866678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-052da3e6-d2d1-4ffe-be13-e3371f7f45ad req-2c95f13d-a28e-4a4f-9f72-a31a3666bb87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032060 Sep 01 05:31:49.867267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 89/173] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:49.999956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.000569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.006921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.007412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.007835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.008693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.009147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.009588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.034808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.038519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.039330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:50.044719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.045252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.045940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.050151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.050151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.050151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.222274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.241966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f01cc1f-a76d-479e-8587-98d17aa0042f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.246404 Sep 01 05:31:50.242632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 85/174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:49 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:50.249711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.257998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c3385da6-3617-4e4d-9c7d-a12876952bc1 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.231639 Sep 01 05:31:50.258633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 90/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:50 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:50.758111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.758717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.765640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.766121 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.767189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.767885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.768331 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.768746 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.774131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:50.794424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.795565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.802565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.803049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.803667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.804612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.805207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.805835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.971371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.979368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1ab336ae-b31c-45af-a5e3-94751d06fd28 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.225405 Sep 01 05:31:50.979942 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 86/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:50 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:51.000290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.007994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d9ad3b32-ce24-4989-b251-40e16fe49c66 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.222197 Sep 01 05:31:51.008574 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 91/177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:50 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:51.264516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:51.265115 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:51.272027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.272027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.272347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.273065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.273535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.273969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.281804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:51.283296 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:51.295677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.301315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.302003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.306092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.306747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.307177 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.351637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:51.525143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.529415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.536011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-406d6bdf-9f27-4797-88d0-6c68596ee9a1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.276259 Sep 01 05:31:51.537000 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 87/178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:51 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:51.546657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5ac742d2-fdaf-4fbf-bd77-f3b2a2183588 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.262318 Sep 01 05:31:51.546657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 92/179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:51 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:52.003342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.004141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.010111 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.010597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.011045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.012723 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.012921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.013341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.028593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.029119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.035176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.035650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.036249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.037078 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.037689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.038246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.271349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.301808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-72091c22-1bf1-42be-9798-1fb7b4efa18e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.300896 Sep 01 05:31:52.302922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.304552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:51 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:52.327090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e3aa0918-3752-48d6-8841-46172ee6e355 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.302459 Sep 01 05:31:52.330233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 88/181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:52.559169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.559998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.560909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.562128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.568665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.569138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.569604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.570269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.570689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.571095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.576462 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.576850 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.577319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.577994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.578426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.578837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.825238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.837643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.844849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4d889f75-a830-488d-a59a-194713e45e4a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.288453 Sep 01 05:31:52.845195 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 89/182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:52.847554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3248d42b-bd8d-4781-99b1-6b0d71a69ec2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.292790 Sep 01 05:31:52.848531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 94/183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:53.330248 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.330851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.339077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.343199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.343896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.346146 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.348373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.348750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.349871 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.350048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.356924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.357407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.357863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.358562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.359009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.359421 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.682966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.688021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.697109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5343e697-9fa3-4746-a620-b4e935aba223 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.352445 Sep 01 05:31:53.697248 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b58306ee-2939-480d-a8fd-7ef02df3a446 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.370669 Sep 01 05:31:53.698404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 90/184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:53.709652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 95/185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:53.871911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.873965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.877201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.878243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.883713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.884741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.885491 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.886407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.886528 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.895343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.896263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.898235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.902232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.902232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.902232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.902232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.212361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.217827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.220963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7b450c1e-cbb9-418f-b33a-9f947d7c8a27 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.351521 Sep 01 05:31:54.222708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 91/186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:54.228944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f0b2a5-67bc-4a0b-a725-16a3c66c472d", "name": "network-vif-plugged", "status": "completed", "tag": "9c9d109d-5428-4c12-b14a-04e96ba61b6f"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:54.229855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3697d34-d49f-4bda-8b62-b3efd9da4bb4 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.364825 Sep 01 05:31:54.244048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.244820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.245506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.247182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 96/187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:54.260212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] Creating event network-vif-plugged:9c9d109d-5428-4c12-b14a-04e96ba61b6f for instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d on hv-cinder-85220 Sep 01 05:31:54.265513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ba76235e-3dd0-4d87-9fef-b28bedfdfca3 req-209eb657-aa58-4f3e-a927-b30555b4b38e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041318 Sep 01 05:31:54.266112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 92/188] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:54.732787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.733377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.735054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.735920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.740889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.741389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.741831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.742522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.742969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.743380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.743494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.744151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.744825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.746079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.746826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.748742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.964889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.967885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.973604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-518930b8-00fc-4743-a5df-0d55a36cafb5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.244238 Sep 01 05:31:54.974290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 93/189] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:54.975763 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c32b9c7b-9f8a-4c0f-ac3d-8f0cd7063907 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.250733 Sep 01 05:31:54.976326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 97/190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:55.243612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.244221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.250898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.251377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.251807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.252482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.252926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.253340 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.260253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.260849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.267375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.267852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.268281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.268989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.269482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.269903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.466538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.473859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.474840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e8e68e19-d696-454c-99fc-7f79624ec30c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.234913 Sep 01 05:31:55.475421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 94/191] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:55.484237 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d15170f0-05c2-4e40-96f4-ecb38ce829c3 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.227385 Sep 01 05:31:55.485494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 98/192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:55.994402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.995119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.998939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.001336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.002573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.007639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.007639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.007639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.007639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.008215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.011931 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.012831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.013617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.014843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.015633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.016379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.229328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.232950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.240803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ad70b866-6060-439a-9b52-d1b14ba57537 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.250118 Sep 01 05:31:56.241400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 95/193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:56.252078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5922ca62-6485-433a-9b1e-0320e4a485d2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.259409 Sep 01 05:31:56.268176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 99/194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:56.496744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.497519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.503544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.504015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.504432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.505119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.505562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.505970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.514004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.514829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.522258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.523097 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.523939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.524864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.525813 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.526470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.901323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.907965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.909948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-73228446-ef75-4493-afea-a8640edfbff8 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.408571 Sep 01 05:31:56.910529 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:56.914441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c6809208-2c71-45fd-a872-d0afd7747b69 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.422231 Sep 01 05:31:56.915090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 96/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:57.262195 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.262875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.269114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.269628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.270053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.270782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.271227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.271639 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.273022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.273672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.280133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.280609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.281037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.281742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.282194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.282607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.462194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.470271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5c435747-5c82-4bdc-bb45-68cb3c4afe95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.211994 Sep 01 05:31:57.471006 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 101/197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:57.474138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.482585 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f2db46f0-0d18-4116-8b65-acdb05d8c9fe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.213196 Sep 01 05:31:57.483201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 97/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:57.931368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.931994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.936098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.936705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.938367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.938852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.939281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.939961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.940404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.940818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.942605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.943081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.943507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.944181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.944625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.945038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.140976 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.144813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.149546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e2dc05b9-f4b4-48f6-ba86-26ca3e089452 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.222121 Sep 01 05:31:58.150073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 102/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:58.165682 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-448aa8b2-7904-4fed-9b9e-464f3f683cf1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.233660 Sep 01 05:31:58.166247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 98/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:58.491652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.492522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.499441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.499929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.506672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.506672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.506672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.506672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.510488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.513544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.541575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.542058 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.544648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.545013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.546959 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.547388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.703500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.717265 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-130327ad-4323-4496-9dbc-e5e04df2d55c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.228943 Sep 01 05:31:58.718626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 103/201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:58.731928 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.741707 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ae235792-74e1-4355-ac4a-840ff98e498b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.238416 Sep 01 05:31:58.742326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 99/202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:59.175478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.178966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.190102 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.190956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.215591 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.216049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.216663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.217127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.217882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.218376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.218767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.220418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.221273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.223714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.224179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.224598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.801707 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.809216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.815112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aab9cb33-7b4e-4db8-96b7-b12ba44dff16 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.646619 Sep 01 05:31:59.816562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 104/203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:59.822334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-32780724-4699-4203-92ea-28d046c5877a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.637711 Sep 01 05:31:59.822824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.823738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.830828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.831597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.832105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.832865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.833379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.833895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.836443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 100/204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:59.843946 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.843946 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.851007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.851848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.852472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.853388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.854183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.855470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.135186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.140549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.147605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7692beae-cfda-4d3a-b775-9d7a14e09ea8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.329792 Sep 01 05:32:00.148169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 105/205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:00.152516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ae81b221-3ffd-4e31-8aa3-779fe51ff5f4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.314079 Sep 01 05:32:00.153407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:00.836398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.836999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.853958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.854512 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.855182 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.859405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.859948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.860966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.861430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.861584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.861938 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.862050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.862543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.863716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.863716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.864034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.123128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.127444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.132312 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3929b035-5227-4289-bd88-9b7607a5cf48 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.291491 Sep 01 05:32:01.133079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 102/207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:01.135756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5c531994-4e19-48d5-b623-9d0e8f67b644 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.303275 Sep 01 05:32:01.137415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 106/208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:01.171547 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:01.172143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:01.175229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:01.176013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:01.178204 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.178685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.179108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.180545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.181137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.181726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.187675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.187675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.187675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.187675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.188074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.188074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.201785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:01.415331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.416821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.426714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aa9f8d17-6896-462b-8c2a-925e60916b9e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.255422 Sep 01 05:32:01.431396 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-54ac849a-0434-4f6c-a3b6-b7cbaae85bcd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.264794 Sep 01 05:32:01.431970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 103/209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:01 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:01.433582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 107/210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:01 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:01.448781 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bedbeaf-c165-4774-b947-dd14b08dcb67", "name": "network-vif-plugged", "status": "completed", "tag": "4163992e-a815-4b35-a6b7-0bc2d7c7b1c1"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:01.461469 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.461883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.462302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.480395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] Creating event network-vif-plugged:4163992e-a815-4b35-a6b7-0bc2d7c7b1c1 for instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 on hv-cinder-85220 Sep 01 05:32:01.486492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-bf14ee16-6c0c-4bca-ad3b-2ea11b062182 req-ddfbca65-6d14-41c2-9725-1fa130063022 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051458 Sep 01 05:32:01.487085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 108/211] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:02.156673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.157445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.159503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.161266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.163748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.164309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.164849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.165788 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.166284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.166762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.169394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.169834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.170267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.172353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.172353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.172353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.433028 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.443231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f30e1ffd-f238-4cb3-83ef-67dba6a8c6a4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.293025 Sep 01 05:32:02.457691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.457691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:02.457691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-39b2933d-d982-43b8-84fb-d715236079f6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.303451 Sep 01 05:32:02.458156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:02.458863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 104/213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.464530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.465129 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.472547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.473038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.473517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.479254 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.480115 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.480224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.480224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.480406 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.482244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.482833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.483497 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.484444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.485234 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.485917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.724409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.727734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.738738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-be119cba-c4fd-4127-be3a-f6bf1ac3ef5d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.268642 Sep 01 05:32:02.739632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 105/214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.763555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1d692382-f6b8-4686-aed3-17cd0a574efe tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.303695 Sep 01 05:32:02.764074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 110/215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.464562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.465790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.472137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.472613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.473098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.473930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.474929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.475668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.480183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.481636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.490178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.490735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.491352 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.492104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.492707 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.493265 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.691821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.697520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.704097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7151667f-d2fa-42ff-ac8c-62b57e32e22b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.243826 Sep 01 05:32:03.717740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d96e948d-8312-4870-861c-090396eb61fa tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1315 microversion: 2.1 time: 0.232158 Sep 01 05:32:03.719759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 106/216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.721341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 111/217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.743084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daf7696-f2c7-4c63-b929-03cc743b8ea2", "name": "network-vif-plugged", "status": "completed", "tag": "d484bf56-8ee3-4920-858a-0b66b9e65df5"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:03.757040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.757040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.757903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.761300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.762339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.770169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.770652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.771451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.772651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.773254 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.773862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.774739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] Creating event network-vif-plugged:d484bf56-8ee3-4920-858a-0b66b9e65df5 for instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 on hv-cinder-85220 Sep 01 05:32:03.780680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-79ea6750-f281-4c3a-aa34-4ac1bacb97ba req-b1236350-1d20-48a1-9b97-7da3ba56e013 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052412 Sep 01 05:32:03.781825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 107/218] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:03.789344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.792579 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.798407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.798407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.798738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.799593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.800043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.800535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.078640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.081790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.086837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1581034c-6d20-4b02-92dd-e8be637b8d37 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.330707 Sep 01 05:32:04.097282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b47bd0e1-3ad5-45e6-b95a-1c91b6ab88dd tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1361 microversion: 2.1 time: 0.313689 Sep 01 05:32:04.099726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 108/219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:04.105319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 112/220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:04.728089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.729841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.731507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.734070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.737890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.738541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.739729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.740755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.741656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.742223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.743172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.743844 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.744756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.746098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.746630 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.747642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.219927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.223106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.229222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-78d43dc3-6af2-4a8c-9c1b-a3edf551b61b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.501945 Sep 01 05:32:05.234024 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0356a875-2c7f-4c0f-9092-1d8225bc2726 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1503 microversion: 2.1 time: 0.506033 Sep 01 05:32:05.234151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 113/221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.234234 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 109/222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.237414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.239977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.247532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.248305 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.248736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.249498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.249933 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.251841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.252494 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.258549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.259036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.259519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.260689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.261294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.262408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.269527 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.599873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.616128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f79d12b1-0343-488c-80e1-174b5320ee6f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1547 microversion: 2.1 time: 0.368851 Sep 01 05:32:05.616717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 110/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1547 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.638923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.640650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.650935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.650935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.650935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.650935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.651306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.652509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.661224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.674266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19d2c73b-1c02-475a-990d-d0e77db7608d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.441323 Sep 01 05:32:05.675143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 114/224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.873856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d680d765-4c03-465a-a60d-8cc6006de0a3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238980 Sep 01 05:32:05.874828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 111/225] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:06.253777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.254460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.262683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.263863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.264493 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.265482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.266135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.266754 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.691492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.698601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.700082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.703512 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-935d8c52-9aa0-407e-9c3a-cb8069772181 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.456222 Sep 01 05:32:06.704244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 115/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:06.713112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.714914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.714914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.716441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.717576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.718649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.139942 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:07.148939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-424f8a98-91f5-443e-b021-b028562ac693 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1321 microversion: 2.1 time: 0.456979 Sep 01 05:32:07.149536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 112/227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:07.660771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed02a46-8470-424b-a900-23405ff45d0c", "tag": "518d51c5-0ec9-4de4-971a-46ed87c7ba5b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:07.674194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.674194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.674194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.686092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] Creating event network-changed:518d51c5-0ec9-4de4-971a-46ed87c7ba5b for instance 9ed02a46-8470-424b-a900-23405ff45d0c on hv-cinder-85220 Sep 01 05:32:07.691522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c7373ec2-d219-4147-b7b9-25e20b14b556 req-6f85b008-8da3-4551-8273-792a3b7e6316 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034563 Sep 01 05:32:07.692109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 116/228] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:07.724638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.725433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.736141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.736141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.736141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.737081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.737173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.737597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.931290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:07.944546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b7efd754-cdab-4995-be6f-32714676e59e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1365 microversion: 2.1 time: 0.223183 Sep 01 05:32:07.958072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 113/229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:08.173746 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.173746 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.188201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.188201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.188201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.188201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.189027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.189027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.341765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "331446fe-15bf-4840-a0fe-7efc7d3b3c87"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:08.344128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.351343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.352072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.356405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.356405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.356405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.356405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.389402 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.399565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8b79e0b0-6c33-490a-b291-85a4a49ba2b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1515 microversion: 2.1 time: 0.232749 Sep 01 05:32:08.400727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 117/230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:08.423107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:08.425726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.436286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.436977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.437730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.438628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.439224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.439638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.512663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'flavor' on Instance uuid 7daf7696-f2c7-4c63-b929-03cc743b8ea2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:32:08.922665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-00c997c3-db09-4de0-b63f-8cf685a26a72 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2/action" status: 200 len: 32 microversion: 2.1 time: 0.503299 Sep 01 05:32:08.923868 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 118/231] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:32:08 2022] POST /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2/action => generated 32 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:32:08.936279 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.937220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.958898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.960929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.962520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.963275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.966528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.971325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.181158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.191142 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fcbd137a-7d90-4314-8ad1-f66eff3e98fb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.260072 Sep 01 05:32:09.205859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.211231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.212040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.218920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.219491 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.220147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.221121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.222159 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.222689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.368093 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.377123 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a5c1773c-b584-492c-bb1d-6cee7feb98c1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1555 microversion: 2.1 time: 0.169722 Sep 01 05:32:09.378060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 120/233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.399158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.399864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.409164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.409684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.410259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.411090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.411681 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.412238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.502609 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9171c5ee-11ce-47d0-9315-c4f22315e31b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107332 Sep 01 05:32:09.503430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:10.212408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.214096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.226583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.227372 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.227956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.229263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.231559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.232610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.655686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.666327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cd61c4eb-2651-40b0-9bcf-7d0ea425a9a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.457896 Sep 01 05:32:10.680912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 122/235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:10.692779 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9acfd828-d6d7-4b34-8b83-920ee3d7e037 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "POST /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.355530 Sep 01 05:32:10.720933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 114/236] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:32:08 2022] POST /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46/os-volume_attachments => generated 194 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:11.356797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bedbeaf-c165-4774-b947-dd14b08dcb67", "tag": "4163992e-a815-4b35-a6b7-0bc2d7c7b1c1"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:11.371805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.372270 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.372678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.384813 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] Creating event network-changed:4163992e-a815-4b35-a6b7-0bc2d7c7b1c1 for instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 on hv-cinder-85220 Sep 01 05:32:11.391040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-cd215044-b20d-4031-9add-a9c0b28c8e84 req-bfcf8bd4-0b2f-4385-b665-e65977146fd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038412 Sep 01 05:32:11.391717 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 123/237] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:11.689049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.689775 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.708619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.709201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.709576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.711131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.713765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.715995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.984399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.992988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-13ab3e8d-d22b-416d-a9b7-b231b947293f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.308245 Sep 01 05:32:11.993910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:13.017919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.019138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.031350 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.031834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.033002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.038168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.038640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.039078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.201026 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.209912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7ff7ba43-97e3-438c-8cef-dc3aad80a61c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.198660 Sep 01 05:32:13.210552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 124/239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.230847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.231442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.240909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.241630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.242056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.242748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.243188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.243587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.379545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.387288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-425d3de6-e4ce-456a-bc49-0940aaf8719e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.160369 Sep 01 05:32:14.387842 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 116/240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:15.408564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.409243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.415266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.415744 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.416173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.416849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.417348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.417818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.568329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.577571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7ce7593c-4973-4137-a6aa-6d2f6204d9d3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.172936 Sep 01 05:32:15.578389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 125/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:16.597860 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.598459 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.600954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=82 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:16.606263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.606837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.607266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.607952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.608613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.609268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.771808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.780556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a07ee11c-724f-472c-8a43-1ebd7c5c5d86 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.186457 Sep 01 05:32:16.781128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 117/242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:17.802380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.802865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.810070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.810556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.811187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.811882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.812480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.812907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.817237 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:17.954538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:17.963287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bec80500-39ca-4dee-8d29-245c97ca2820 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.164910 Sep 01 05:32:17.964451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:18.984172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:18.985397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:18.991877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.992358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.992783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.993479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.993937 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.994485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.207081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.215730 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6ce96cec-9571-47d4-b91c-061babf267f0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.235336 Sep 01 05:32:19.216305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 118/244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:18 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:20.236319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:20.236934 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:20.238967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=74 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:20.244777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.246651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.246651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.247716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.248351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.249234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.407971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:20.416174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e66dc01b-75e9-4070-8036-1785e115aaee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.183979 Sep 01 05:32:20.417367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 127/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:20 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:21.439038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:21.439695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:21.446125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.446597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.447031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.447710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.448965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.449415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.623738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.627432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:21.632128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c5a7bcf2-3b6e-49a2-88ef-89c97a964774 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.196982 Sep 01 05:32:21.632786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 119/246] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:21 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:22.662755 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:22.662755 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:22.664889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.665509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.666096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.668209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.668663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.669086 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.805978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.815353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8c50a97a-657c-4d8d-bec7-75f1707e77b2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.165838 Sep 01 05:32:22.816137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 128/247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:22 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:23.836384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:23.836985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:23.843808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.844288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.844711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.845391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.845871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.846281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.977840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.986276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-73633db8-2769-421b-bee2-8ee75307ef2f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154007 Sep 01 05:32:23.986839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 120/248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:23 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:25.007377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:25.008073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:25.014107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.014588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.015013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.015695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.016137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.016612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.143010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:25.150592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9d98da34-83da-4f1d-8634-e684f2da5245 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.147000 Sep 01 05:32:25.152702 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 129/249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:25 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:26.173178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:26.173792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:26.180190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.180658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.181076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.181772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.183437 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.183877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.311124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.318706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0d0474a5-0bb5-4d09-917a-ee9873a59a18 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.149271 Sep 01 05:32:26.319255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 121/250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:26 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:27.340169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:27.340771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:27.346762 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.347243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.347672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.348354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.348800 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.349216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.478162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:27.486250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-30f2cdd9-baaf-48a0-931a-3606170b3ce2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.150030 Sep 01 05:32:27.486812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 130/251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:27 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:28.507643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:28.508242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:28.515225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:28.515718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:28.516124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:28.516804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:28.517244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:28.517703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:28.645264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.653657 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-532bb388-3dab-4002-b669-ef5624abf1b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.149827 Sep 01 05:32:28.656256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 122/252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:28 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:29.675572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:29.676182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:29.683273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.683750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.684181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.684863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.685307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.685781 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.818353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.826267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-61b8563b-7973-4cbf-bba1-0f130ab0182d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154653 Sep 01 05:32:29.826827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 131/253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:29 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:30.847029 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:30.847635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:30.854509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.854988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.855422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.856111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.856565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.857001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.991557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:30.999799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c9acb0d8-1c0b-4d85-baef-497649242504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.156589 Sep 01 05:32:31.000416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 123/254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:30 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:32.020974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:32.021639 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:32.028642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.029161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.029614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.030284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.030720 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.031128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.162259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.170154 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3220ee22-1250-4238-b938-1e4c97f8a254 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.152980 Sep 01 05:32:32.170726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 132/255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:32 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:33.191210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:33.191805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:33.198790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.199264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.199685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.200358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.200802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.201207 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.340084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.347887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cca3666e-578c-485a-b856-afec814f7e91 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.160487 Sep 01 05:32:33.348445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 124/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:33 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:34.368251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.368848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.375234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.375705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.376128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.376801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.377236 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.377683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.504456 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.512048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f237d1c3-8c1a-4988-abfa-61498ec1a9b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.147449 Sep 01 05:32:34.512598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 133/257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:35.533532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:35.534161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:35.540434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.541357 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.542118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.542809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.543247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.543659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.678444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.686893 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e57ad3d0-e7d5-4f5f-8107-e6d4f8462d4b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.158634 Sep 01 05:32:35.687452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 125/258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:35 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:36.539361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:36.539864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:36.547224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.547711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.548139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.548837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.549278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.549743 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.575900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:32:36.707738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:36.708259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:36.715659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.716137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.716561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.717242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.717781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.718165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.853414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.864120 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-94fbf7c7-bbc3-439d-a004-2cbae2a7458d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.160294 Sep 01 05:32:36.866117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 126/259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:36 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:36.917311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4336598a-1537-4bca-81d1-7f5459528f00 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 204 len: 0 microversion: 2.1 time: 0.381598 Sep 01 05:32:36.918049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 134/260] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:32:36 2022] DELETE /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:36.926805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:36.927392 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:36.934194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.934662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.935175 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.935852 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.936287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.936695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.075390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.083561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-abb1921c-b356-4abf-aa3b-7562c6f41cf6 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.160902 Sep 01 05:32:37.084125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 127/261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:36 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:37.886334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.886985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.892891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.893363 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.893824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.894499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.894937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.895349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.032059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.039997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c41682e2-f7a6-4cb9-8fb9-5b39615d4857 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.158120 Sep 01 05:32:38.040587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 135/262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:37 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:38.104033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:38.104940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:38.111662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.112135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.112559 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.113230 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.113700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.114112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.251742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.255791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b6f4aa88-bfb7-4c70-b8d6-474c48e9796f tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.155505 Sep 01 05:32:38.256378 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 128/263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:38 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:39.063002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.063557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.069427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.073037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.073037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.073037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.073037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.073602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.210495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.219001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ab997ea7-1db8-4279-a990-1f9148032941 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.161152 Sep 01 05:32:39.219577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 136/264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:39.277011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.277632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.283930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.284404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.284824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.285524 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.285968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.286382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.414979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.424489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2919ba7a-697e-4c85-81ef-e0d523c2ff03 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.151312 Sep 01 05:32:39.425952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 129/265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:40.244712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.245397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.257393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.258602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.259249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.260749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.261399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.262222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.413950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.421906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cc0d8d22-9ab1-443b-bcaa-beee206ccfda tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.185888 Sep 01 05:32:40.422469 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 137/266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:40.446820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.447417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.454404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.454818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.455243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.455922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.456414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.456863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.586239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.595122 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5b2dac44-cf65-41ac-bfc8-e745f5bdf378 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.152318 Sep 01 05:32:40.595683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 130/267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:41.442833 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.443446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.449381 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.450517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.450946 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.451626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.452065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.452477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.590396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.598629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-31d3cb85-6f31-4ade-90d2-fa7574a620fa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.159503 Sep 01 05:32:41.599204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 138/268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:41.616379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.617329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.624568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.625123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.625666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.626422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.626950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.627464 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.763728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.772091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cb7296e5-6b39-4bb7-92a0-d270ece17843 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.159484 Sep 01 05:32:41.772652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 131/269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:42.620134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.620742 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.627119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.627601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.634128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.634128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.634128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.634128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.762915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.770870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9955d983-0cb8-44ba-a074-f1a848bbd3f8 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154635 Sep 01 05:32:42.771423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 139/270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:42 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:42.793036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.793771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.800387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.800935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.801430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.802227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.802676 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.803090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.970546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.984253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8058eac2-ca2d-46d9-b037-c47bd697d780 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.193174 Sep 01 05:32:42.984253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:42 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:43.199835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2727d2ef-de94-4553-9ce1-ec70f0a67f46", "name": "network-vif-unplugged", "status": "completed", "tag": "3c31cd04-d4d8-4de9-a16a-af5c1528b81b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:43.210012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.210425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.210847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.222128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] Creating event network-vif-unplugged:3c31cd04-d4d8-4de9-a16a-af5c1528b81b for instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 on hv-cinder-85220 Sep 01 05:32:43.227172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-346f222c-bc7a-41c8-a83d-49789aa17e51 req-2e3c5859-bf0f-4838-a5c1-211a6c7a0afa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031017 Sep 01 05:32:43.227903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 140/272] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:43.792630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.793439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.799643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.800124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.800552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.801236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.801714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.802131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.958556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.968095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3556c701-9656-42e4-9177-e8a71bc2ffa9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.179284 Sep 01 05:32:43.968670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 133/273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:44.004384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.005101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.011366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.012021 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.012456 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.013209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.014164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.014164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.149258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.153433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:44.158591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f608096f-d852-4679-8e02-fea788032c3a tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.158682 Sep 01 05:32:44.159153 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 141/274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:44.989906 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.990520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.997349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.997934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.998368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.999069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.999538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.999928 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.179895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.180494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.189056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.193935 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.194419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.194839 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.195529 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.196073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.196366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.205231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b16dec8a-437d-4b14-ab0d-f2f76eb1c760 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.219126 Sep 01 05:32:45.205840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 134/275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:45.463293 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.471695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c46e97cc-3142-4192-9f3d-f817a4079b09 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1555 microversion: 2.1 time: 0.295657 Sep 01 05:32:45.472359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 142/276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:45.950621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2727d2ef-de94-4553-9ce1-ec70f0a67f46", "name": "network-vif-deleted", "tag": "3c31cd04-d4d8-4de9-a16a-af5c1528b81b"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:45.964258 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.964738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.965755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.980026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] Creating event network-vif-deleted:3c31cd04-d4d8-4de9-a16a-af5c1528b81b for instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 on hv-cinder-85220 Sep 01 05:32:45.987885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ca33c2b0-7dd6-4934-911c-88640842718c req-29d29505-0606-474c-a73a-0a6d9f0a48ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040978 Sep 01 05:32:45.988595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 135/277] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:46.229908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.230435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:46.237065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.238183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.238183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.238636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.239076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.239486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.368523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.376894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a4e07067-5d1e-4c5c-81f7-1c728eedb76b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.150874 Sep 01 05:32:46.377477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 143/278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:46.494572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.495210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:46.501555 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.502034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.502466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.503147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.503597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.504012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.569078 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.578608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-14d56ead-8250-49ba-92c0-d83365b35858 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1346 microversion: 2.1 time: 0.088831 Sep 01 05:32:46.579178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 136/279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:47.398348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.398960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.405571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.406247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.406862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.407555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.408158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.408771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.540687 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.549205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8f5f0c70-d518-4a0e-9c16-596273e53e88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154989 Sep 01 05:32:47.549894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 144/280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:47.599544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.602840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.602840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=40 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:47.607848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.608499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.608889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.609609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.610056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.610479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.614477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:47.676301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.686095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-70f3a28a-45f5-4975-b7d0-82d8800e39de tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1346 microversion: 2.1 time: 0.090506 Sep 01 05:32:47.686725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 137/281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:48.571441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.572150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.578648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.579132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.579560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.580245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.580686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.581103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.707456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.708171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.712458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.722580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d7b6411b-b580-47cb-b854-f6af6755faee tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154993 Sep 01 05:32:48.724044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 145/282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:48.731841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.732342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.732778 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.735910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.736502 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.737336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.769960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.770426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.770844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.771284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lazy-loading 'fault' on Instance uuid 2727d2ef-de94-4553-9ce1-ec70f0a67f46 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:32:48.821806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e529f3610d114981a5a3d37bdf832dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f237ba116b64751bee9817c19226b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.830745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-52599a47-04be-4155-8713-164087939573 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 200 len: 1351 microversion: 2.1 time: 0.127948 Sep 01 05:32:48.831301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 138/283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 1351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:49.747440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.748057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.754035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.754512 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.754933 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.757922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.757922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.757922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.852172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.853327 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.860458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.861658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.861658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.862114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.862738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.863172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.022463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] HTTP exception thrown: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Request method failure captured: Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 HTTP/1.1 Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOOV5HN_Al7HMgTRl8BMt8zu7AU93kx4r01Q-cYXesN4jYyC2MiMZbUFX5GYnj_flUIzeqaYZrVKpqyxfIKDMaOyM9-oa0EvkJX5pOOuBlAA8ILnyQZpLJEzHimRRyp3028Ds6mVkoFCxKoAfmAwuga-2gOecbFxsZTc1Cda-kU6bc Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:32:50.027048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f237ba116b64751bee9817c19226b3f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e529f3610d114981a5a3d37bdf832dab Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.028883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '2727d2ef-de94-4553-9ce1-ec70f0a67f46'} Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:32:50.029627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.030774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.031839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Returning 404 to user: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:32:50.031839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5bc3d204-3d53-425e-b35e-b9347f6d4b43 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 404 len: 111 microversion: 2.1 time: 0.180408 Sep 01 05:32:50.031839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 139/284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:32:50.100628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.108606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dca58a42-75b3-4ada-83c0-68f726a3106c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.365662 Sep 01 05:32:50.109168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 146/285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:50.446218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:50.448433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:50.456016 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.456541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.456965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.457680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.458119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.458533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.471605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] HTTP exception thrown: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Request method failure captured: Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46/os-volume_attachments HTTP/1.1 Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOOV5HN_Al7HMgTRl8BMt8zu7AU93kx4r01Q-cYXesN4jYyC2MiMZbUFX5GYnj_flUIzeqaYZrVKpqyxfIKDMaOyM9-oa0EvkJX5pOOuBlAA8ILnyQZpLJEzHimRRyp3028Ds6mVkoFCxKoAfmAwuga-2gOecbFxsZTc1Cda-kU6bc Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:32:50.473762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f237ba116b64751bee9817c19226b3f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e529f3610d114981a5a3d37bdf832dab Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.475289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'server_id': '2727d2ef-de94-4553-9ce1-ec70f0a67f46'} Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:32:50.476094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:32:50.477441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:32:50.478800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Returning 404 to user: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:32:50.478800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e34939ab-bba2-4445-8663-c2846e559545 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033663 Sep 01 05:32:50.478800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 140/286] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:32:50 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:32:51.130061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.130656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.132583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:51.137356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.139695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.139695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.139695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.139695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.140044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.272232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.280673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d47449db-9c3f-414e-9016-2122a471853c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.154425 Sep 01 05:32:51.281232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 147/287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:52.302738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.303359 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.311235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.311715 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.312144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.312822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.313272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.313732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.443708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.452091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-da79e0d5-1dc9-4a9c-bf27-7d2831083386 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.153225 Sep 01 05:32:52.452646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 141/288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:53.472562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:53.473374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:53.479791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.480284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.481443 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.482148 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.482591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.483096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.625335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.633909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f27ca512-ea12-44ab-ba57-2bcb99e2a906 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.164804 Sep 01 05:32:53.634428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 148/289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:53 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:54.663352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.663352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.664164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.664642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.665071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.665791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.666235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.666651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.810434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.818306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f5f7a300-deff-4732-a827-3b9f97612852 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.165446 Sep 01 05:32:54.818963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:55.839556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.840213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.846329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.846804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.847232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.847917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.848358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.848941 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.994525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.003389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-02c1d5bc-edf1-4df1-a76f-e5b6979b81d2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.167608 Sep 01 05:32:56.003974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 149/291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:57.024640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.025797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.032902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.036737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.037186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.037904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.038356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.038771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.174436 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.184026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-eb981f23-35f4-4629-a8f5-af69cc00da0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.163370 Sep 01 05:32:57.184685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 143/292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:58.204486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:58.205084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:58.211983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.212473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.212920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.213613 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.214065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.214485 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.358940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.367703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-70ec9fb8-4757-4970-a2e7-025b8a93e8d5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.167212 Sep 01 05:32:58.369001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 150/293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:58 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:59.389597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.390195 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.396629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.397108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.397572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.398258 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.398705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.399122 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.534978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.542677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b5cc2154-e90c-49f9-86fd-ea939222d2a4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.157632 Sep 01 05:32:59.545821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 144/294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:00.564534 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.565121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.571018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.571488 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.571908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.572577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.573008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.573411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.705308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.714176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e7b8dfa1-e93b-47fa-bb98-e933ae5771a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.153346 Sep 01 05:33:00.714927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 151/295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:01.735153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:01.735754 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.742170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.742647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.743075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.743759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.744202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.744617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.877353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.885044 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-937e6b74-0dd8-4998-b245-10c0b84e3d4d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.153810 Sep 01 05:33:01.885629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 145/296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:01 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:02.907695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:02.908427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:02.916434 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.916909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.917331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.918052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.918495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.918975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.055998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.064660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eeddb587-ff02-4e93-82c9-56cb472eb4b9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.160842 Sep 01 05:33:03.065262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 152/297] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:02 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:03.520137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.520656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.527077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.527554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.527977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.528656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.529217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.529709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.543003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] HTTP exception thrown: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Request method failure captured: Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 HTTP/1.1 Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOOV5HN_Al7HMgTRl8BMt8zu7AU93kx4r01Q-cYXesN4jYyC2MiMZbUFX5GYnj_flUIzeqaYZrVKpqyxfIKDMaOyM9-oa0EvkJX5pOOuBlAA8ILnyQZpLJEzHimRRyp3028Ds6mVkoFCxKoAfmAwuga-2gOecbFxsZTc1Cda-kU6bc Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:33:03.544534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f237ba116b64751bee9817c19226b3f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e529f3610d114981a5a3d37bdf832dab Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.546723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '2727d2ef-de94-4553-9ce1-ec70f0a67f46'} Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:03.547567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.548972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.550882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Returning 404 to user: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:03.550882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-009ddc28-fe38-4d11-a4c5-96a219d6fbbe tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 404 len: 111 microversion: 2.1 time: 0.030444 Sep 01 05:33:03.550882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 146/298] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:33:03 2022] DELETE /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:33:03.555295 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.561638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] [instance: 2727d2ef-de94-4553-9ce1-ec70f0a67f46] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.563067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.563543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.563966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.564635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.565074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.565503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] HTTP exception thrown: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Request method failure captured: Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 HTTP/1.1 Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOOV5HN_Al7HMgTRl8BMt8zu7AU93kx4r01Q-cYXesN4jYyC2MiMZbUFX5GYnj_flUIzeqaYZrVKpqyxfIKDMaOyM9-oa0EvkJX5pOOuBlAA8ILnyQZpLJEzHimRRyp3028Ds6mVkoFCxKoAfmAwuga-2gOecbFxsZTc1Cda-kU6bc Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:33:03.584828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9f237ba116b64751bee9817c19226b3f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9f237ba116b64751bee9817c19226b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 9f237ba116b64751bee9817c19226b3f Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-DeleteServersTestJSON-137578417 Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: e529f3610d114981a5a3d37bdf832dab Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-DeleteServersTestJSON-137578417-project Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.586745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '2727d2ef-de94-4553-9ce1-ec70f0a67f46'} Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:03.587576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. Sep 01 05:33:03.588846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:03.590128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] Returning 404 to user: Instance 2727d2ef-de94-4553-9ce1-ec70f0a67f46 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:03.590128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b938a0ce-7705-4f83-a4a8-30811d95e324 tempest-DeleteServersTestJSON-137578417 tempest-DeleteServersTestJSON-137578417-project] 10.222.0.42 "GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46" status: 404 len: 111 microversion: 2.1 time: 0.034816 Sep 01 05:33:03.590128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 153/299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/2727d2ef-de94-4553-9ce1-ec70f0a67f46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:33:04.087384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.088095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.095899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.096383 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.096814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.097537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.097998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.098402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.323721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.335003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c3712510-aaa4-4076-81a3-9f4225f50375 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1521 microversion: 2.1 time: 0.251499 Sep 01 05:33:04.336210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 147/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:05.356199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.356886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.364013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.364566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.365058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.365861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.366368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.366845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.742325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.750780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0e0b83e2-3573-49d1-a72f-9bbea66d3949 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1501 microversion: 2.1 time: 0.398415 Sep 01 05:33:05.751418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 154/301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1501 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:05.771687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.772304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.778665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.779143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.779566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.780317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.781390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.781830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.005760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:06.009557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b29571e0-e13c-4fe1-90e0-4d9d20a8da3c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1515 microversion: 2.1 time: 0.241788 Sep 01 05:33:06.010178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 148/302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:11.065592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:11.067828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.073947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.074426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.074851 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.075534 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.075972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.076374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.110365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'flavor' on Instance uuid b3f0b2a5-67bc-4a0b-a725-16a3c66c472d {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:11.402870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a13761f6-047b-4584-9970-504625aa3b8e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/action" status: 200 len: 32 microversion: 2.1 time: 0.341249 Sep 01 05:33:11.403504 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 155/303] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:33:11 2022] POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:33:11.413845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:11.414520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.422116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.422641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.423091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.423819 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.424311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.424729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.564013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.571736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a95e4968-6ec4-45fc-9ae1-251ea94db589 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.161951 Sep 01 05:33:11.572291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 149/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:11 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:12.594915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:12.595625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:12.601843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.602314 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.602731 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.603404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.603843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.604258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.739311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.747974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-871c2d08-c527-4826-a7dc-d0323b9fa00b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.157417 Sep 01 05:33:12.748565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 156/305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:12 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:13.768753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:13.769355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:13.776319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.776794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.777215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.777936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.778510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.779136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.911905 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:13.919727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b17a99b8-4526-40ed-8c69-c6d255fb4576 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.155504 Sep 01 05:33:13.920790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 150/306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:13 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:14.940875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:14.941433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:14.947489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.947969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.948398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.949083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.949551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.949971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.954347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:15.156955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.164721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b9392ed8-c178-4f52-8f55-e8f4646f4ddb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.228533 Sep 01 05:33:15.165280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 157/307] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:14 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:16.187349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:16.187947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:16.194603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.195077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.195512 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.196172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.196609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.197019 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.357015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.366233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-304abf76-38b1-4e46-b4ec-f2ef64e905a0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.183005 Sep 01 05:33:16.366800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 151/308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:16 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:17.387589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.388191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.394020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.394497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.395132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.395983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.396763 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.396905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.528301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:17.536044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ff219e68-b038-49ef-9e9a-457d59f6afab tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.152140 Sep 01 05:33:17.536601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 158/309] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:17 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:18.556257 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:18.556893 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:18.559206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=32 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:18.563910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.564390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.564825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.565537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.565987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.566404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.699106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.707018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bcbba77e-6bc7-4f7e-87d1-87541410a33c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.154726 Sep 01 05:33:18.707575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 152/310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:18 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:19.728286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.728977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.735853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.736334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.736758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.737464 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.737915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.738331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.876784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.884509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b91527b-ed31-4fb7-988b-1ca6e2d03f3a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.160249 Sep 01 05:33:19.885060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 159/311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:20.905975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:20.906624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:20.913609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.914086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.914510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.915189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.915887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.916453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.922101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=85 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:21.059576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.067641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0f0a0240-b3c3-4715-9698-ef08300216e3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.166085 Sep 01 05:33:21.068205 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 153/312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:20 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:22.088194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.088850 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.090818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=26 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:22.096066 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.096541 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.096968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.097681 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.098122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.098531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.235625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.243436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4ae0ba38-5190-4643-a4ab-6582848ec640 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.159001 Sep 01 05:33:22.244188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 160/313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:23.265729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.266586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.273707 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.274196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.274627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.275317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.275766 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.276219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.409826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.417570 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-53d732da-d957-46e7-b620-97c52c2a27b3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.155888 Sep 01 05:33:23.418132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 154/314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:24.440396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:24.441259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:24.447561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.448035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.448454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.449126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.449777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.450191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.671187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.679322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c232d9ff-5625-4b09-ba0b-8c40b15f2629 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.242789 Sep 01 05:33:24.679894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 161/315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:24 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:25.700319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:25.701157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:25.707878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.708366 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.708796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.709597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.710040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.710454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.846168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.855088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8074b537-bb87-4fd9-acec-95802f108eba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.158613 Sep 01 05:33:25.855692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 155/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:25 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:26.875561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:26.876196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:26.882201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.882685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.883115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.883796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.884242 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.884652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.012631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:27.021419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fcdb50f5-48eb-4887-ae7a-2c3e18717f95 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.149948 Sep 01 05:33:27.022047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 162/317] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:26 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:28.042439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:28.043038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:28.049439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.049956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.050411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.051086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.051530 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.051945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.186882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.194653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d89a0fe7-5ac9-4a27-bd5f-0c0b5ae2f3b4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.156068 Sep 01 05:33:28.195210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 156/318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:28 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:29.216122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:29.216883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:29.222857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.223407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.223843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.224562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.225119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.225560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.358086 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.365683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9ff2dcec-e76f-4add-8085-6b0b8946d341 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.153400 Sep 01 05:33:29.366238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 163/319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:29 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:30.390093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:30.390796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:30.397127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.397774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.398206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.398902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.399371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.399766 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.534101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.541836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f1e9d294-92a7-4c32-81ba-8b7253477c03 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.156249 Sep 01 05:33:30.542391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 157/320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:30 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:31.564361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:31.564952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:31.570857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.571322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.571742 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.572415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.572852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.573258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.699951 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.708331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-24dca34d-aaef-489e-ac04-3d9113cada61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.148731 Sep 01 05:33:31.710349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 164/321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:31 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:32.729251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.729894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.736314 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.736785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.737213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.737917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.738361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.738780 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.877520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.885433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cdf0dc11-eed8-4b5a-b9db-186995a8a616 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.160084 Sep 01 05:33:32.886006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:33.906281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:33.907554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:33.913795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.914265 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.914685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.915355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.915789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.916192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.043203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.051948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-82fb5da3-6062-45a1-b267-bef381832d0e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.149428 Sep 01 05:33:34.057591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 165/323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:33 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:35.074126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:35.074722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:35.082140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.082614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.083040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.083706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.084145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.084557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.212794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.220694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9ee9b75e-566e-4d4e-83e0-62697a4a7e30 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.150382 Sep 01 05:33:35.221251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 159/324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:35 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.242241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.242867 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.251481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.251481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.251481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.251481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.251878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.251971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.383624 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.392479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-101c1d25-c335-40b8-a7d8-643281727450 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1501 microversion: 2.1 time: 0.154227 Sep 01 05:33:36.393198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 166/325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.413877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0346560-63ae-4664-b3bd-8d6477e82312"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:36.416221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.423215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.423694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.424161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.424802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.425393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.425933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.450237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] HTTP exception thrown: Cannot 'attach_volume' instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d while it is in vm_state rescued Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Request method failure captured: Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/os-volume_attachments HTTP/1.1 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 74 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOTilPmjLHUpc35T_H93PzmVCOJ8fwmm3-rr34RiGHnBn665patDoOtYLkcXOBRcitkamnlR6GUvghNmh6dvzlvOZu2SwKmE32HBvjZFbFf82zRYYuwi4rO3RnXXsKLtzL_ltpMUmBSRzgOIfIEgSVEPgEn9zahOijYyY11Z37fGf0 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:33:36.451818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdbdacacad0f48c6a9238643e67ac6eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: fb50b15e44814c6b82b2a75e3c74de0a Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {"volumeAttachment": {"volumeId": "d0346560-63ae-4664-b3bd-8d6477e82312"}} Sep 01 05:33:36.453925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Cannot 'attach_volume' instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d while it is in vm_state rescued Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'server_id': 'b3f0b2a5-67bc-4a0b-a725-16a3c66c472d', 'body': {'volumeAttachment': {'volumeId': 'd0346560-63ae-4664-b3bd-8d6477e82312'}}} Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:36.455767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d while it is in vm_state rescued Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:36.456948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d while it is in vm_state rescued Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Returning 409 to user: Cannot 'attach_volume' instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d while it is in vm_state rescued {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0411d51d-c6d4-42f9-a111-c8d101ade34c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043647 Sep 01 05:33:36.458390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 160/326] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:33:36 2022] POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:33:36.464289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:36.465072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.471557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.472065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.474155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.474155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.474155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.474155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.724836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e7edbf51-160f-4d82-85b9-d8c60cde448a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/action" status: 202 len: 0 microversion: 2.1 time: 0.264538 Sep 01 05:33:36.729078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 167/327] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:33:36 2022] POST /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:36.734580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.735298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.741352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.741865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.742295 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.742972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.743415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.743825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.873892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.882556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-64b3591a-4e18-4519-8822-6f4077bdb7a3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1509 microversion: 2.1 time: 0.151852 Sep 01 05:33:36.883048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 161/328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:37.903660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:37.904354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:37.910769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.911246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.911674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.912347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.912790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.913199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.054524 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.062637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-819d7137-4cb7-4a00-b8bd-9be8eebec79d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1509 microversion: 2.1 time: 0.163211 Sep 01 05:33:38.063281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 168/329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:37 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:39.085956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:39.086556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:39.092818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.093288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.093972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.094661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.095101 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.095513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.235346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.243526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-378dccfd-4ecf-4468-8d06-f01e3aa0796a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1509 microversion: 2.1 time: 0.162569 Sep 01 05:33:39.245055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:39 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.264888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.265997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.273527 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.274008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.274436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.275144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.275572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.275982 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.436632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.444942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fcc9d5ac-c824-476d-8e14-1d43e35811ae tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1509 microversion: 2.1 time: 0.183927 Sep 01 05:33:40.445523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 169/331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:41.466553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.467161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.474264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.474797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.475263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.475935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.476377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.476784 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.616697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.624431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4c2a748b-27bb-4ad2-bb94-dd2ff5d1a555 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1515 microversion: 2.1 time: 0.161738 Sep 01 05:33:41.625056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 163/332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:43.512071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bd08e0c5-6665-4720-b133-6693a67a0874 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: .version_select at 0x7fbb6ca40af0>, body: {"keypair": {"name": "tempest-keypair-6957177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn0fn+KSAloeb1DVvwKHcmktrBe0TdtIrkMX4FH45kVfwXbk4+sKUNrbsTRvGUnK3z0cPQTZwjTTmJ7LamFb21hneVj6U1LpHWH/tz5KstJ5P+xHJ7UjyspasuidktTlA=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:43.528545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-bd08e0c5-6665-4720-b133-6693a67a0874 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:43.532980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-bd08e0c5-6665-4720-b133-6693a67a0874 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for user fb50b15e44814c6b82b2a75e3c74de0a and project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:43.652174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bd08e0c5-6665-4720-b133-6693a67a0874 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.143986 Sep 01 05:33:43.652907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 170/333] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:33:43 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:46.639220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1270139874", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "856c62ca-f5e7-40ea-ba7e-4517ff30bca8"}], "security_groups": [{"name": "tempest-securitygroup--2033402136"}], "key_name": "tempest-keypair-6957177", "user_data": "}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:46.770976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] validate_networks() for [('856c62ca-f5e7-40ea-ba7e-4517ff30bca8', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:33:47.269859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:33:47.270278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:33:47.270841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:33:47.271280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:33:47.271742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:33:47.282667 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.283175 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.283601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.284458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.284848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.285266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.305921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:47.310192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Getting quotas for user fb50b15e44814c6b82b2a75e3c74de0a and project cdbdacacad0f48c6a9238643e67ac6eb. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:47.322688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:33:47.324988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:33:47.471657 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-531ee797-a897-4e81-b5dd-9c3fe8acba61 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.836783 Sep 01 05:33:47.472629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 164/334] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:33:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:33:47.484914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5de1a17a-7714-460f-a844-aa85af2166ea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.487213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5de1a17a-7714-460f-a844-aa85af2166ea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.571149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5de1a17a-7714-460f-a844-aa85af2166ea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.581415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5de1a17a-7714-460f-a844-aa85af2166ea tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1243 microversion: 2.1 time: 0.101685 Sep 01 05:33:47.582547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 171/335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1243 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:48.603308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.603918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:48.605829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:48.611574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.614425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.614985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.615668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.616081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.622606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.693835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.701896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bad5de1b-6fa2-418c-9d36-a8a6689a4966 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1247 microversion: 2.1 time: 0.102741 Sep 01 05:33:48.703276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1247 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:49.533404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-35621029", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "networks": [{"uuid": "49076a23-fce7-4f64-8ab6-a26d8d6b551c"}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:49.587472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] validate_networks() for [('49076a23-fce7-4f64-8ab6-a26d8d6b551c', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:33:49.727359 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.728817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.745695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.746185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.746618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.747374 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.747765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.748229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.872904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.881907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-619462e8-8252-45a1-a11e-d924f4b37c32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1295 microversion: 2.1 time: 0.161779 Sep 01 05:33:49.882690 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 166/337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:50.148461 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:33:50.149158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:33:50.149944 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:33:50.150697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:33:50.151263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:33:50.162691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.163172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.163599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.164353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.164798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.165222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.173060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:50.184249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Getting quotas for project 10dd440ea6f54e0497536117ccba4c9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:50.188679 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Getting quotas for user b2c0f79be80341a483f02509d774007f and project 10dd440ea6f54e0497536117ccba4c9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:50.200137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:33:50.202707 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:33:50.376607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9ea47b52-7c76-4fc0-b674-e25a9b77cd88 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847658 Sep 01 05:33:50.381834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 172/338] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:33:50.395195 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-757169af-f213-482d-881e-085ff85c1af6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.406192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-757169af-f213-482d-881e-085ff85c1af6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.487940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-757169af-f213-482d-881e-085ff85c1af6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.496047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-757169af-f213-482d-881e-085ff85c1af6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1217 microversion: 2.1 time: 0.110267 Sep 01 05:33:50.496617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 167/339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:50.903784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.904526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.911945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.912446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.912892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.913641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.914113 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.914524 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.166432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.174509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-09c897b2-827c-4e0a-b74a-60394d9b7979 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.274620 Sep 01 05:33:51.175082 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 173/340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:51.517106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fe790024-1e1b-472a-98bf-0897b2d3eb26 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.517978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fe790024-1e1b-472a-98bf-0897b2d3eb26 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.574418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fe790024-1e1b-472a-98bf-0897b2d3eb26 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.582839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fe790024-1e1b-472a-98bf-0897b2d3eb26 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1217 microversion: 2.1 time: 0.070504 Sep 01 05:33:51.596740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 168/341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:52.146956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:52.159157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.160058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.160662 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.178192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] Creating event network-changed:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:33:52.185355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-bbefc9ae-531c-4880-bd19-bb70fde7a94c req-5931abba-2a50-4a35-a9d9-b4a96119aa06 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043483 Sep 01 05:33:52.187100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 174/342] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:52.198658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.199349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.207679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.208421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.208973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.209857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.210306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.211001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.218453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=78 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:52.395844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.400723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1c83c26b-5357-40d2-9571-c31034ccd62f tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.208225 Sep 01 05:33:52.401280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 169/343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:52.604868 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.605711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.614442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.615570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.616303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.619561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.619561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.619561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.007638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.015185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fa59d3cb-b659-4498-a1d9-dd1524e7589a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1269 microversion: 2.1 time: 0.414126 Sep 01 05:33:53.015967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 175/344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1269 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:53.423221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.423876 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.430738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.431213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.431629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.432390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.432833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.433242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.671558 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.679451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9f431058-9132-44b2-bc8a-41606bde1aba tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.261291 Sep 01 05:33:53.680372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 170/345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:54.036682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.037284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.044335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.044797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.045218 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.046481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.046921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.047332 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.116878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.125983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb1caddf-1b99-402b-b492-32d4632ce742 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1275 microversion: 2.1 time: 0.093111 Sep 01 05:33:54.126664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 176/346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:54.706144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.706836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.714088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.714600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.715034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.715733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.716179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.716593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.871026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.878907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1c341106-9ed5-4396-9712-ef8326319699 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.177241 Sep 01 05:33:54.879480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 171/347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:55.148481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:55.149083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:55.151223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:55.156381 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.156857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.157274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.158336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.159105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.159848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.303871 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.312981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-21cd351f-e8eb-498d-a911-488c9fd4694a tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.168213 Sep 01 05:33:55.313566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 177/348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:55 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:55.899936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:55.900541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:55.907715 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.908201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.908627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.909304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.909776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.910201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.039580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.047609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6007b948-ea28-47a9-8487-14f751de332c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.151494 Sep 01 05:33:56.048162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 172/349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:55 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:56.333994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:56.334628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:56.340776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.344055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.344055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.344055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.344055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.344457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.477161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.490582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-749c7805-4e72-4b8e-a2b2-d6fa629f78e1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.159725 Sep 01 05:33:56.492104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 178/350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:56 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:57.068421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.069024 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:57.075500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.075974 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.076401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.077864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.078480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.079072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.293563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:57.314595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.329494 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d1fc735b-d9c7-41bd-a7a7-e6ca69843d81 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.263588 Sep 01 05:33:57.329494 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 173/351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:57 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:57.506021 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71532039-11bb-456e-a66d-4d1f916a0c52", "tag": "3f94d020-4ba5-40ed-b80d-981fc2a45d13"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:57.515098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.516136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:57.530936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.535739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.536478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.537826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.538644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.539157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.539620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.540210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.541153 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.703790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] Creating event network-changed:3f94d020-4ba5-40ed-b80d-981fc2a45d13 for instance 71532039-11bb-456e-a66d-4d1f916a0c52 on hv-cinder-85220 Sep 01 05:33:57.708920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-e10d343a-bd69-4aa2-ab95-837407f513b1 req-1f173162-fcae-489e-a94c-15afd7c37433 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207047 Sep 01 05:33:57.709694 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 179/352] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:57.765508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.773305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0ee73838-af6f-472b-9854-90e1e3869b0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.264951 Sep 01 05:33:57.773908 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 174/353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:57 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:58.350036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:58.350758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:58.357108 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.357619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.365171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.365171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.365171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.365171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.517043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:58.525238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b58b3ce8-75ca-4478-9054-d637cb615b5a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.179381 Sep 01 05:33:58.526175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 180/354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:58 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:58.794324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:58.794917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:58.801694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.802165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.802660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.803241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.803678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.804085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.922204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "name": "network-vif-plugged", "status": "completed", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:58.936651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.937407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.938179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.957928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] Creating event network-vif-plugged:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:33:58.965577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c30b96bd-5e48-48cb-9bff-94fd50a80727 req-91ab63b3-9dc5-478e-a7bd-37acb8ac1d1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049424 Sep 01 05:33:58.966482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 181/355] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:58.973870 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:58.979371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3b5d7ac0-291a-436a-a5ac-64af3411f4bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.188831 Sep 01 05:33:58.979933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 175/356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:58 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:59.550546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:59.556581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:59.557544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.558019 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.558479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.559226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.559672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.560083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.712716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.723137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-099bd377-35c7-4976-a52a-b39e74a997d0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.176964 Sep 01 05:33:59.724328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 182/357] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:59 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:00.000955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:00.001578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:00.007912 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.008380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.008807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.009485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.009929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.010338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.155644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.165795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3d469421-a3dd-448e-9cf2-650ae4f14611 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.169034 Sep 01 05:34:00.166423 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 176/358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:59 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:00.745440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:00.746079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:00.753802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:00.754747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=12 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:00.756467 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.757143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.757858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.767002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.767002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.767002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.915687 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.923269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-40ab72de-f7eb-4d59-8e08-11b8b721b638 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.181945 Sep 01 05:34:00.924954 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:00 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:01.186442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:01.187575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:01.193797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.194515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.194951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.195653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.196100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.196522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.492073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:01.505538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1163a9fb-2333-49d0-84e3-9e14d1facc55 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.322821 Sep 01 05:34:01.506650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:01 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:01.946071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:01.952081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:01.954171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.954588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.955015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.955696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.956140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.956555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.137626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.145660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b144c29-18d2-4bf6-8a51-efb5a10fc420 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.203693 Sep 01 05:34:02.146440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 184/361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:01 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:02.530527 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.531121 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.533260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=10 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:02.539114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.540167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.540595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.541751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.542410 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.542850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.694864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.703247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-39d7197a-f127-4190-a55c-59722e436c62 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.177419 Sep 01 05:34:02.704027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 178/362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:02.985581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71532039-11bb-456e-a66d-4d1f916a0c52", "name": "network-vif-plugged", "status": "completed", "tag": "3f94d020-4ba5-40ed-b80d-981fc2a45d13"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:02.995127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.995602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.996023 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.006762 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] Creating event network-vif-plugged:3f94d020-4ba5-40ed-b80d-981fc2a45d13 for instance 71532039-11bb-456e-a66d-4d1f916a0c52 on hv-cinder-85220 Sep 01 05:34:03.011671 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-a0742f79-6018-4f0c-b430-4c1c7b9f13d0 req-98626dde-256a-4abf-a779-a8493cb15160 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Sep 01 05:34:03.012244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 185/363] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:03.166889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.167489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.174137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.174610 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.175042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.175740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.176195 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.176615 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.331164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.339152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6c67dcdf-b8dc-47d3-a9bf-5f3ac664852a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1369 microversion: 2.1 time: 0.176595 Sep 01 05:34:03.339718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 179/364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:03.724776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.725360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.731909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.732387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.733448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.734260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.734709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.735124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.924806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.932689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0a002457-8462-426d-b795-76ae809eb0b2 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.212377 Sep 01 05:34:03.933253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 186/365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:04.364874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.364874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.368425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.368703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.369131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.369840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.370290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.370705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.500504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.508123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ac023c8e-62f7-4b0b-8ed2-c641a6ce473c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1563 microversion: 2.1 time: 0.151869 Sep 01 05:34:04.508870 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 180/366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:04.529228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.529850 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.535657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.536126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.536548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.537219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.537714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.538124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.616608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b0c9d980-5ad4-4dc9-bb9e-563ae46f1dd3 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091317 Sep 01 05:34:04.617194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 187/367] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:04.954563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.955171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.962395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.962874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.963298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.963977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.964420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.964827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.227934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.236185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fae3aad1-2ab1-4639-bb7d-b71b003961bd tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1317 microversion: 2.1 time: 0.286302 Sep 01 05:34:05.237353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 181/368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:05.976797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:05.980760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.981235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.981671 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.994898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] Creating event network-changed:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:34:06.004247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-b8cf3b9b-73ca-4cfe-9cf2-b848fe3586ab req-0950a304-4603-4f1a-b8b7-e8a65b08d6d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038117 Sep 01 05:34:06.005171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 188/369] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:06.258550 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.259822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.267396 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.268540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.269136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.270073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.270483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.271075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.534890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.547972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-baa037e9-1c24-4f1d-9b9b-0d8efde36d02 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1505 microversion: 2.1 time: 0.292100 Sep 01 05:34:06.549607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 182/370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:27.591928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:27.592489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:27.594924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=23 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:27.595572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=75 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:27.601489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.601957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.602374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.603050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.603481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.609383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.627659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9044afb7-6d0b-404b-a94b-467a009b4a18 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039839 Sep 01 05:34:27.628216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 189/371] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:34:27 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:30.133817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2030486961", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:30.141239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:34:30.141390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 01 05:34:30.143256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=39 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:30.143936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=83 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:30.190653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] validate_networks() for None {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:30.467143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:30.467656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:30.468219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:30.468724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:30.469383 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:30.478997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.479541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.480031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.480740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.481176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.481663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.498652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Getting quotas for project 9fb5b12fc7e045bc96a33630d5088740. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:30.502484 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Getting quotas for user a4e8ad7c8b4b4c9d83c0456b777e9e87 and project 9fb5b12fc7e045bc96a33630d5088740. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:30.514476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:30.516767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:30.694448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-341f5dd7-2817-495a-8ca8-78ed6a677174 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564905 Sep 01 05:34:30.695165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 183/372] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:34:30.707248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-41763364-3766-44c2-9b66-439be4368713 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:30.708095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-41763364-3766-44c2-9b66-439be4368713 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:30.770644 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-41763364-3766-44c2-9b66-439be4368713 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.778540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-41763364-3766-44c2-9b66-439be4368713 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1215 microversion: 2.1 time: 0.075809 Sep 01 05:34:30.779080 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 190/373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:30 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:31.178767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58892867-9cc1-4861-a367-c64564b55bf0"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:31.181853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:31.187936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.188435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.188920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.189637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.190083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.190551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.800238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ac2e299b-707f-4343-8a45-1d7f1d402a92 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:31.800841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ac2e299b-707f-4343-8a45-1d7f1d402a92 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:31.854187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ac2e299b-707f-4343-8a45-1d7f1d402a92 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.861224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ac2e299b-707f-4343-8a45-1d7f1d402a92 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1215 microversion: 2.1 time: 0.064921 Sep 01 05:34:31.861821 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 191/374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:31 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:32.161143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0982448d-b03c-401d-b507-8be710ffb182 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986883 Sep 01 05:34:32.162262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 184/375] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:31 2022] POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments => generated 194 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:32.882539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.883076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.889937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.891233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.891233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.891523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.891975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.892373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.953102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.961469 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-51299b6f-5208-4c91-b164-e59fc95139e7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1211 microversion: 2.1 time: 0.082898 Sep 01 05:34:32.962054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 192/376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:32 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:33.993127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:33.995091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.010980 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.012791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.012791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.018225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:34.018719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.022347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.022881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.026519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.027349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.032399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.035368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.035368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.035368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.035368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.082587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-616e9fc3-06f9-43a6-954c-48aaa6c7bca6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/ips" status: 200 len: 149 microversion: 2.1 time: 0.068239 Sep 01 05:34:34.083165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:34:34 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:34.139371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.152613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-acbdebac-d91e-4ec1-9844-99b1a9417fc1 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1275 microversion: 2.1 time: 0.172790 Sep 01 05:34:34.155055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 185/378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:33 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:35.182444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.183250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.189367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.190017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.190553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.191233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.191787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.192202 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.253895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:35.262326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3f5a4b6a-b3fd-4acc-9e51-f004d36524c0 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1273 microversion: 2.1 time: 0.084187 Sep 01 05:34:35.262872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 194/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:35 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:36.263208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22147a31-e2f4-449a-a816-c5b7b1ae4cb6", "tag": "d5b157ee-d10e-4da6-8ca6-9e09c4a6b965"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:36.274715 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.275251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.275673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.284375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:36.287619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:36.289052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] Creating event network-changed:d5b157ee-d10e-4da6-8ca6-9e09c4a6b965 for instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 on hv-cinder-85220 Sep 01 05:34:36.293166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.293695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.294128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.294825 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.295189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-3b148885-ead8-4dd5-af42-cec579ffc633 req-ee519851-a704-4c06-b01c-5a8ad7d44775 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Sep 01 05:34:36.295669 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.296105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.296834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 186/380] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:36.530529 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.538766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8013cec6-6b52-4088-b8e0-421302ad0d04 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.258038 Sep 01 05:34:36.540579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 195/381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:36 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:36.938296 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a4a7bc3-d642-46c6-a8cd-634fc000d893"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:36.940694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:36.947549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.948255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.948936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.949673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.950127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.950545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.559653 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.560273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.566276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.566750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.567172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.567871 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.568308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.568713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.695540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.703137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7bd864a2-4f86-45e5-ac62-3474be76afa7 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.147312 Sep 01 05:34:37.703678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 196/382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:38.724245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.725026 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.731214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.731704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.732135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.732847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.733292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.733736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.864318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.872146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a2dba4c2-db6b-4400-8f7b-3b2c84ec5ebe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.151878 Sep 01 05:34:38.872817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 197/383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:39.894170 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:39.894764 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.901329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.901834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.902253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.902923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.903360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.903774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.030797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.039120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3ecea490-af83-4975-989d-8f5d63878397 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.149036 Sep 01 05:34:40.039674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 198/384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:39 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:40.489139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:40.509623 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:41.059696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:41.060256 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:41.066242 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.066719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.067143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.068365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.068774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.069186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.208943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:41.216646 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-50f8550a-c8d8-42e4-a097-e5d1da63996d tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.160821 Sep 01 05:34:41.217203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 199/385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:41 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:42.238498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:42.240230 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.243051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:42.248282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.248964 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.249395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.250103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.250657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.251066 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.297242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9af422ee-3a90-48ce-a7c8-393951c62b0f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.362948 Sep 01 05:34:42.298149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 187/386] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:36 2022] POST /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments => generated 194 bytes in 5365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:42.305059 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40262fab-0682-4cdd-b5e4-64ce3bb269a5", "device": "/dev/sdb"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:42.309313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.316708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.317294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.317817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.318850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.319635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.320224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.398431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.406836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-65a15e61-6ed9-4bfa-882d-d07693e3e89f tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.173437 Sep 01 05:34:42.412192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 200/387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:42 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:43.436713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.437310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:43.444881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.445373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.445828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.446523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.446970 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.447389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.479253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a1621b83-fb4a-4a83-bc94-d0fa2f4eeddc tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "POST /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.179321 Sep 01 05:34:43.479863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 188/388] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:42 2022] POST /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52/os-volume_attachments => generated 194 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:43.485727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22147a31-e2f4-449a-a816-c5b7b1ae4cb6", "name": "network-vif-plugged", "status": "completed", "tag": "d5b157ee-d10e-4da6-8ca6-9e09c4a6b965"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:43.498058 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.498534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.499158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.512085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] Creating event network-vif-plugged:d5b157ee-d10e-4da6-8ca6-9e09c4a6b965 for instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 on hv-cinder-85220 Sep 01 05:34:43.517192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-0b6decf8-b61d-4b46-915c-5acf0bf5ae71 req-58f4919b-6e17-495f-9526-8776fe439ef3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035760 Sep 01 05:34:43.517822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 189/389] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:43.597831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.607101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-06d8f08e-c3af-4d98-b290-b7206d9dd888 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.173321 Sep 01 05:34:43.607101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 201/390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:43 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:43.940958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:43.947289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.947762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.948181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.014000 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Going to try to stop instance {{(pid=121033) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:34:44.238574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bd23f8a3-7b0b-48ef-b731-f716f022634f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.301545 Sep 01 05:34:44.239319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 190/391] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:34:43 2022] POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:34:44.247326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.247935 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.254099 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.254574 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.255508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.256224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.256672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.257090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.385169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.393469 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5873bddd-9011-473d-8606-caf376b1e50f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.149959 Sep 01 05:34:44.394025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 202/392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:44.626989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.627678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.634409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.634888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.635336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.636022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.636458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.636866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.770864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.778725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6ca44a5f-6955-4c5a-bd4a-3ff8ffc87f59 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.155898 Sep 01 05:34:44.779290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 191/393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:45.415337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.415919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.421963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.422444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.422865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.423544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.423985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.424396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.565981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.574409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-40061846-2d19-4ade-966c-39a47711fb6b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.163668 Sep 01 05:34:45.574966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 203/394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:45.799952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.800554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.807833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.808313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.808742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.809419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.809893 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.810303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.943814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.951408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-09f9158f-988e-4ca5-a45a-cccc2a5754b4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.155464 Sep 01 05:34:45.951960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 192/395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:46.595207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.603064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.603064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.603472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.603623 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.604313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.604759 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.605172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.735373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.743732 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9176c2a8-9b64-4ac7-a779-918f62ad0b1f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.152613 Sep 01 05:34:46.744292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 204/396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:46.972015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.972655 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.980902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.981379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.981838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.982516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.982960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.983376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.110398 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.118783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2069f1e4-dc72-4520-8dc0-57fb5e1789ce tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1465 microversion: 2.1 time: 0.150572 Sep 01 05:34:47.119338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 193/397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:47.164215 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.164729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.170777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.171267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.171695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.172378 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.172826 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.173243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.198523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:47.441953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-199093ba-e25e-4290-a577-e5a4cb515117 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 204 len: 0 microversion: 2.1 time: 0.281471 Sep 01 05:34:47.443064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 205/398] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:47 2022] DELETE /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:34:47.451230 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.451882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.458724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.459193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.459620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.460301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.460744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.461157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.593177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.601401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c06d420c-a182-4bd9-ac4e-b5939ebf33fe tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1471 microversion: 2.1 time: 0.153976 Sep 01 05:34:47.601989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 194/399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:47.764884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.765605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.771896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.772382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.772813 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.773521 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.773969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.774392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.792972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:47.903169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.911820 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cfc4008f-4d2a-4e65-b9e9-849990612112 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.150696 Sep 01 05:34:47.912538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 206/400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:48.623463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:48.624053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:48.631372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.631903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.632330 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.633004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.633447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.633891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.766573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:48.774892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c09c729a-4f06-4288-95ae-cae69b591ae5 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1471 microversion: 2.1 time: 0.155302 Sep 01 05:34:48.775455 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 195/401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:48 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:48.933719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:48.934240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:48.940136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.940607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.941032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.941729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.942185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.942586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.071166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.079590 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8205a581-0b09-41ee-8b08-fccd0365d6ae tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.149723 Sep 01 05:34:49.080147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 207/402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:48 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:49.796358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:49.796958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:49.804289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.808574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.808574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.808574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.808574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.808936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.826990 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:49.943731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.951476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ccb5871f-1ec4-4363-9471-e485613932dc tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1471 microversion: 2.1 time: 0.159006 Sep 01 05:34:49.952036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 196/403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:49 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:50.104670 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.105280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.111272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.111750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.112182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.112863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.113312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.113764 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.240692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.248914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7d124c93-64b3-4194-a39c-c52f3a77ddd7 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.148087 Sep 01 05:34:50.249502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 208/404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:50.972693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.973432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.980832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.981491 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.981727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.982584 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.983026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.983435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.041773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22147a31-e2f4-449a-a816-c5b7b1ae4cb6", "name": "network-vif-deleted", "tag": "d5b157ee-d10e-4da6-8ca6-9e09c4a6b965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:51.057241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.057759 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.058356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.069622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.082173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7bbe21f2-b050-4ded-acec-14ae932b9795 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1429 microversion: 2.1 time: 0.113795 Sep 01 05:34:51.082992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 197/405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:51.086711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] Creating event network-vif-deleted:d5b157ee-d10e-4da6-8ca6-9e09c4a6b965 for instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 on hv-cinder-85220 Sep 01 05:34:51.092368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-05a403db-fafa-4115-9e42-8e868cd2c122 req-8f7f6a34-f461-4c91-9133-aa9545abf3d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054521 Sep 01 05:34:51.093710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 209/406] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:51.269833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:51.270394 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:51.276791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.277278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.277728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.278413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.278862 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.279272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.480660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.495475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dc695437-5331-492b-af3e-63ad65b4d640 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.229625 Sep 01 05:34:51.496052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 198/407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:51 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:51.961018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83366585-e010-4b88-977a-286501765f91 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: .version_select at 0x7fbb6bd3b1f0>, body: {"keypair": {"name": "tempest-keypair-498283298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsGHCHLC9veyIX2ye7or0OEakpqwT+B81kVInkVjpYfYA4PtHkArvASU4c/oS9EBssYpH1h0ENM8lN6HSQ+hEO7UCxfF8rdrn6SHzJs/CYuPjsd8J7SrT39FeuuFsfVrA=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:51.976076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-83366585-e010-4b88-977a-286501765f91 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:51.980044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-83366585-e010-4b88-977a-286501765f91 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:52.075920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-83366585-e010-4b88-977a-286501765f91 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119261 Sep 01 05:34:52.076709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 210/408] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:34:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:52.103486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.104091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.110602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.111088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.111516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.112215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.112660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.113076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.148114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.148596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.149037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.149520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lazy-loading 'fault' on Instance uuid 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:52.191195 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e8ad7c8b4b4c9d83c0456b777e9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb5b12fc7e045bc96a33630d5088740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.199376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2ec7cf2e-36fe-41a0-bcd0-fdbc98ee8296 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 200 len: 1305 microversion: 2.1 time: 0.099820 Sep 01 05:34:52.200118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 199/409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:52.518556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.519124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.525482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.525972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.526398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.527090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.527514 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.527925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.662376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.670727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9cacce68-c6e8-458c-8c6b-664fb497d37c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.156124 Sep 01 05:34:52.671280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 211/410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:53.220145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.220770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] [instance: 22147a31-e2f4-449a-a816-c5b7b1ae4cb6] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.228319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.228792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.229213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.229912 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.230352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.230757 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.245440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] HTTP exception thrown: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Request method failure captured: Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 HTTP/1.1 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEERhLsglA0fHb91Eu4SZmb-PDEfj2SygWLwH1I8QCGHg3uvbj5vnghWAF5zSGh92t1jvHTS9972M2r3HuDDkyX9CJX2AHESo9gizTIYrPiBJ2yuy7wSzoP5EB00n2G_PC1Q2ojLbrZ9xm14HAcdoYWc0XSJnyxB7ngPnkY2I4tV20Uw Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 9fb5b12fc7e045bc96a33630d5088740 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-VolumesNegativeTest-1342631815 Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:34:53.247083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fb5b12fc7e045bc96a33630d5088740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9fb5b12fc7e045bc96a33630d5088740", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9fb5b12fc7e045bc96a33630d5088740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9fb5b12fc7e045bc96a33630d5088740"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-VolumesNegativeTest-1342631815 Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 9fb5b12fc7e045bc96a33630d5088740 Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-VolumesNegativeTest-1342631815 Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-VolumesNegativeTest-1342631815-project Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: a4e8ad7c8b4b4c9d83c0456b777e9e87 Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-VolumesNegativeTest-1342631815-project Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. Sep 01 05:34:53.248694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '22147a31-e2f4-449a-a816-c5b7b1ae4cb6'} Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:53.249590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. Sep 01 05:34:53.251095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.252190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] Returning 404 to user: Instance 22147a31-e2f4-449a-a816-c5b7b1ae4cb6 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:53.252190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1aaba7e3-b737-4f39-8381-d675f34bb0c4 tempest-VolumesNegativeTest-1342631815 tempest-VolumesNegativeTest-1342631815-project] 10.222.0.42 "GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6" status: 404 len: 111 microversion: 2.1 time: 0.032145 Sep 01 05:34:53.254105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 200/411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/22147a31-e2f4-449a-a816-c5b7b1ae4cb6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:53.692693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.695711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.701167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.702881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.703506 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.704392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.705017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.705442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.850874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:53.859461 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c769bcc2-dc00-46cf-9f54-af0f4af51c3b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.171021 Sep 01 05:34:53.860257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 212/412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:54.371251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1610063302", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292c4ef4-bb7c-4583-ab02-5307a5a77a17"}], "security_groups": [{"name": "tempest-securitygroup--1280253078"}], "key_name": "tempest-keypair-498283298", "user_data": "}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:54.480166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] validate_networks() for [('292c4ef4-bb7c-4583-ab02-5307a5a77a17', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:54.863409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:54.863825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:54.864294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:54.864698 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:54.865100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:54.873947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.874419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.874843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.875557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.876002 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.876420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.882091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:54.883234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.888823 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.889340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.889696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.890384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.890822 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.891429 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.894161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:54.900566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:54.912536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:54.914856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:55.026921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-945508c6-16ad-4212-b1ef-86bd260bb2ce tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659977 Sep 01 05:34:55.027731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 201/413] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:34:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:34:55.028017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.037128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-98dd608c-38df-455f-860a-58e1d5064632 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.159559 Sep 01 05:34:55.037743 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 213/414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:54 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:55.039312 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5c664634-d164-4b0a-b17a-6ca8812f740f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:55.039944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5c664634-d164-4b0a-b17a-6ca8812f740f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:55.096846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5c664634-d164-4b0a-b17a-6ca8812f740f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.105921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5c664634-d164-4b0a-b17a-6ca8812f740f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1241 microversion: 2.1 time: 0.071260 Sep 01 05:34:55.106891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 202/415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:55 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:56.060276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.061037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.069553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.070036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.070458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.072141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.072663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.073068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.131558 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.132275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.139379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.139855 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.140287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.141228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.141719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.144441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.236445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.250700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e9352a71-1719-4e32-a647-98407085db0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1245 microversion: 2.1 time: 0.126498 Sep 01 05:34:56.252075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 203/416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:56.288231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.302136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a886ac43-0934-4878-9124-a04e904c01a6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.246674 Sep 01 05:34:56.304300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:57.278123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.278769 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.285355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.287140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.287140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.287140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.287731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.288145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.325135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.325715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.332339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.334445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.335405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.336312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.337078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.337856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.354073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.361931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-79d8d753-0ad6-46c2-bfbb-3279b605ed2d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1293 microversion: 2.1 time: 0.087710 Sep 01 05:34:57.362488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 204/418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:57.568161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.576571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a6b38174-90f4-40fb-8385-7883d6af4211 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.255298 Sep 01 05:34:57.577131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 215/419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:58.393264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.394176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.402796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.403385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.403821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.404651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.405100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.405540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.484393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:58.493159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-de21483b-1019-4fed-bd55-a422ab90c28d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1299 microversion: 2.1 time: 0.103594 Sep 01 05:34:58.493790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 205/420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:58.598273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.598853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.606299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.606777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.607197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.607878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.608315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.608722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.796228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:58.806014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-42a052b4-3ad8-4ca4-9492-ba8f2749a61f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.211610 Sep 01 05:34:58.806920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 216/421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:59.515319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.518048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.525865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.526514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.527056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.527962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.528498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.529131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.741382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.750475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e883b2f0-3687-4303-8ef1-e6fe2da8eaec tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.239735 Sep 01 05:34:59.751343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 206/422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:59 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:59.827960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.828658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.836163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.836747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.837247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.838539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.838539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.838893 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.069014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.087162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c7658e14-d8b5-4785-8fa3-69bfa76418c1 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1722 microversion: 2.1 time: 0.263088 Sep 01 05:35:00.087913 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 217/423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:59 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:00.256211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d790d97-9608-4cc6-a1a6-52511c16036c", "tag": "40edf63a-12a7-4c65-b315-d1f488a96671"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:00.261134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:00.266848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.267377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.267798 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.281208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] Creating event network-changed:40edf63a-12a7-4c65-b315-d1f488a96671 for instance 5d790d97-9608-4cc6-a1a6-52511c16036c on hv-cinder-85220 Sep 01 05:35:00.286118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-b5c1e2b4-4bc4-427a-8ed9-286c38e702b4 req-274c1ecb-7949-4f3d-8d8b-02325f1c3b34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033566 Sep 01 05:35:00.287823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 207/424] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:00.773948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.774612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.776929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:00.782390 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.782864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.783607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.784301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.784737 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.785142 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.995131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.002748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ad5eb2cd-d56e-4405-9c56-5a8620230e9f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.233709 Sep 01 05:35:01.003312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 218/425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:01.109106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.109850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.116988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.117482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.117971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.118652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.119127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.119545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.254412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.262632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-44621d33-acdc-4a4a-a426-ab1fae7133b8 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1699 microversion: 2.1 time: 0.158184 Sep 01 05:35:01.263187 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 208/426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:01.283345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:01.290244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.290724 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.295903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.352291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Going to try to start instance {{(pid=121031) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:35:01.533388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8218f9b2-71f7-40f5-b29f-d14103008c08 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.253021 Sep 01 05:35:01.534431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 219/427] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:35:01 2022] POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:01.544879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.544879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.550707 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.551183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.551611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.552398 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.552839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.553252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.722637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.722637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ad099d06-e4d1-48a4-81c3-652dbbef8812 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.155888 Sep 01 05:35:01.722637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 209/428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:02.021014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:02.025795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:02.026481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:02.032476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.032959 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.033392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.034096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.034519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.034923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.164870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.172923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-37a85fee-d14c-4281-901e-de1c6cf50b7e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.152839 Sep 01 05:35:02.176580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 220/429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:02 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:02.734438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:02.735022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:02.741600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.742079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.742508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.743189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.743631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.744045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.873345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.882250 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1e888033-39b3-48e5-b814-b35fe5b5acf5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.151776 Sep 01 05:35:02.882811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 210/430] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:02 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:03.194749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.195354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.201861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.202340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.202765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.203453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.203893 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.204304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.331394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.339105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e6ce589f-488b-4ac1-9587-31a280bc576e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.149504 Sep 01 05:35:03.339852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 221/431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:03.903482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.904117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.910322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.913838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.913838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.913838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.913838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.914227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.042725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.050989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c7b1c14f-64de-4d63-92d4-797508b66e35 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.151511 Sep 01 05:35:04.051751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 211/432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:04.359494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.360150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.366776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.367249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.367674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.368349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.368789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.369209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.499218 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.507140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8edcd8c7-cba9-47e0-8758-c263a2a8a6e2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.151502 Sep 01 05:35:04.507699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 222/433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:05.072795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.073402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.075403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:05.080585 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.081060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.081514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.082194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.082638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.083052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.104543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=8 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:05.215902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.224053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c46f4dcd-3efa-4106-8cc2-314beaa51d77 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.155136 Sep 01 05:35:05.225214 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 212/434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:05.529838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.529838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.534686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.535418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.536065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.537676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.538437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.539200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.676451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.680313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:05.686382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ea2a13d1-3a70-4d74-aa7d-ae46c2a18244 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.160314 Sep 01 05:35:05.686382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 223/435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:06.246602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:06.247117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:06.253724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.254204 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.254638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.255320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.256387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.256808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.386175 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.394242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-298b114c-cd78-4c8e-ad1c-ab5de808f330 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.151929 Sep 01 05:35:06.394803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 213/436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:06 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:06.706286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:06.706891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:06.713242 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.713748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.714181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.714877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.715323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.715740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.851607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.859135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2a2d1e13-6c6a-424b-8b45-e65fadf5d8a3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.157024 Sep 01 05:35:06.859690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 224/437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:06 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:07.415227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.415832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.422235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.422713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.423138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.423808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.424250 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.424661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.551352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.560539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-13b07460-f207-4a12-9366-2de7d94b85d3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.149296 Sep 01 05:35:07.561096 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 214/438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:07.879615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.880223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.887028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.887507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.887957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.888644 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.889087 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.889567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.023426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:08.030981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e637af2d-7123-47a1-9254-bb1e37ab52e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.155243 Sep 01 05:35:08.031531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 225/439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:08.582003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:08.582616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:08.589187 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.589702 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.590133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.590812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.591256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.591672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.720448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:08.723851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:08.731039 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3ae0198b-09ac-4377-836a-b7719055fc42 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.152796 Sep 01 05:35:08.731683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 215/440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:08 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:09.051437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:09.052020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:09.058588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.059058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.059477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.060142 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.060578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.060979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.192045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.199668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fd27b3b2-41b4-4018-bd09-029d92393c24 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.151992 Sep 01 05:35:09.200226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 226/441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:09 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:09.753147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:09.753782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:09.761246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.761448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.761906 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.762596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.763045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.763473 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.892976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.901964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-36ed18bb-a70a-4846-ac14-4908bcdc5a3c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.153190 Sep 01 05:35:09.902495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 216/442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:09 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:10.220518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:10.221792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:10.228830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.229327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.229865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.230538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.230971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.231375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.361280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.369152 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9dd01951-7c98-4c9e-be9f-7e8ac37a86b3 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.152496 Sep 01 05:35:10.369832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 227/443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:10 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:10.923065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:10.923663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:10.931414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.931915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.932361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.933040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.933506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.936490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.064253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.072951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5c8aa72d-684a-4e7a-902f-30b61b8a2a72 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.153796 Sep 01 05:35:11.073590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 217/444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:10 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:11.390655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:11.391258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:11.397209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.398562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.398996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.399881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.400329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.400745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.526673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.534195 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b660c40-79fc-4081-bbc0-ac0f6ac34260 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.147335 Sep 01 05:35:11.534752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 228/445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:12.094235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.094924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.102065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.102537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.102974 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.103688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.104129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.104572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.258104 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.266876 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1acd13fd-9b35-446a-9ef6-1a0a2a5bec38 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.176523 Sep 01 05:35:12.267446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 218/446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:12.555233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.555781 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.561738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.562218 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.563845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.563845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.563845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.564303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.692362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.700710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e8b0d1bf-287c-4239-9aee-68f6cd69586a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.149812 Sep 01 05:35:12.701275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 229/447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:13.287977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:13.289290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.295704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.296180 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.296605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.297332 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.297802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.298217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.426847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.435932 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f3e2db2-1369-4726-864e-6e144a2ca958 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.151785 Sep 01 05:35:13.436529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 219/448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:13 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:13.722181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:13.722783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.729692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.730173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.730780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.731270 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.731711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.732120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.858642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.866184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-18082bdf-417f-486c-9a7e-291865673cf5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.147932 Sep 01 05:35:13.866965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 230/449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:13 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.456444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.457039 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.464329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.464803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.465277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.465979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.466418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.466829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.598716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.608471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-186195eb-da7a-4afb-8b1e-7131f6958d91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.155854 Sep 01 05:35:14.609045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 220/450] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.886783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.887384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.893345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.893859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.894292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.894974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.895427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.895843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.024049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.031658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b6fd7002-0732-4081-b7c0-6ca4b860d678 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.149375 Sep 01 05:35:15.032206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 231/451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:15.629694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:15.630282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:15.637002 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.637508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.637938 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.638617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.639061 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.639474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.768178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.776421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a36cb474-1dd0-4b62-9e70-7826431c782b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.150630 Sep 01 05:35:15.776988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 221/452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:15 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:16.053030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.053655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.060416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.060887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.061306 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.062008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.062441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.062845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.192555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.200394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4c171793-6b8e-4a35-8d13-9029381fd763 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.151235 Sep 01 05:35:16.200953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 232/453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:16.797656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.798314 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.805606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.806085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.806512 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.807190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.807632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.808047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.934711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.942831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-42c3c0cd-3993-48f9-bdd3-b5453bd29020 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1708 microversion: 2.1 time: 0.149132 Sep 01 05:35:16.943390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 222/454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:17.220628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.221324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.227834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.228294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.228709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.229375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.229838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.230240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.367164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.375054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-338ccb80-7ebc-4cc6-94ba-2c9d24e58a5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.158329 Sep 01 05:35:17.375612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 233/455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:17.964647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.965300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.971587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.972057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.972478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.973151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.973627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.974042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.103509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.111686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ef937381-c112-498a-affc-ca49543ec97d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1712 microversion: 2.1 time: 0.151818 Sep 01 05:35:18.112244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 223/456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:18.396070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:18.396674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:18.402825 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.403085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.403507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.404186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.404631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.405039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.536243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.544346 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d4d87981-c4bd-4742-a581-8d194ed37257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.152102 Sep 01 05:35:18.544899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 234/457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:18 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:18.783407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d790d97-9608-4cc6-a1a6-52511c16036c", "name": "network-vif-plugged", "status": "completed", "tag": "40edf63a-12a7-4c65-b315-d1f488a96671"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:18.792869 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.793342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.793804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.805108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] Creating event network-vif-plugged:40edf63a-12a7-4c65-b315-d1f488a96671 for instance 5d790d97-9608-4cc6-a1a6-52511c16036c on hv-cinder-85220 Sep 01 05:35:18.810387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ee2cbd04-7498-4f88-94c6-51a9ac5fc4bc req-ef1fb162-6683-4fd2-b27c-22f54554bb6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030649 Sep 01 05:35:18.810966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 224/458] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:19.565083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:19.565625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:19.572092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.572570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.572996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.573722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.574162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.574571 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.707576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.715600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-31feb7e4-8c1f-41be-8047-ff185b67edb9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.154437 Sep 01 05:35:19.716385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 235/459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:19 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.737253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.737984 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.744238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.744711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.745138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.745842 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.746298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.746714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.877168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.885346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3461e178-1352-4878-af4e-a055f7ee7332 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1367 microversion: 2.1 time: 0.152762 Sep 01 05:35:20.885940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 225/460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.915149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.915640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.921540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.922019 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.922444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.923122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.923566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.924004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.056116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lazy-loading 'services' on Instance uuid 71532039-11bb-456e-a66d-4d1f916a0c52 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:21.297727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9214f68a-ea40-4a9a-9721-4926a3d9fb73 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52/os-volume_attachments/40262fab-0682-4cdd-b5e4-64ce3bb269a5" status: 202 len: 0 microversion: 2.1 time: 0.386254 Sep 01 05:35:21.298228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 236/461] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:35:20 2022] DELETE /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52/os-volume_attachments/40262fab-0682-4cdd-b5e4-64ce3bb269a5 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:21.906907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:21.907451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:21.914159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.914638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.915065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.915753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.916203 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.916616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.045389 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.052935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-303d4b05-c32c-4596-925c-9a3839295c8e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1556 microversion: 2.1 time: 0.150022 Sep 01 05:35:22.053503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 226/462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:21 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:22.073869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:22.074447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:22.080612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.081115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.081567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.082271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.082729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.083139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.160297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f0c23f60-6cfa-406f-8721-c478966d7599 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090789 Sep 01 05:35:22.160887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 237/463] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:35:22 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:23.407660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d790d97-9608-4cc6-a1a6-52511c16036c", "tag": "40edf63a-12a7-4c65-b315-d1f488a96671"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:23.417701 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.418172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.418596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.431045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] Creating event network-changed:40edf63a-12a7-4c65-b315-d1f488a96671 for instance 5d790d97-9608-4cc6-a1a6-52511c16036c on hv-cinder-85220 Sep 01 05:35:23.436017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-dfdfd3b6-7293-4fc7-af33-b6786cefe2dd req-895e77a0-8d4e-44ab-999c-2825a73f20e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Sep 01 05:35:23.436908 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 227/464] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:23.478415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.478959 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.485034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.485620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.486045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.486739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.487184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.487596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.515756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:35:23.637556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:23.855163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b8136388-c0de-447c-a46f-5a6be4c84c31 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 204 len: 0 microversion: 2.1 time: 0.380574 Sep 01 05:35:23.855977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 238/465] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:23 2022] DELETE /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:23.864564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.865289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.872472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.872960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.873388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.874118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.874563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.874977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.024963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.034162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1b937fc2-e5d7-4f45-8255-2e6486b14925 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1511 microversion: 2.1 time: 0.173506 Sep 01 05:35:24.034849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 228/466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:25.057147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.057793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.063977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.064451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.064882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.065594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.066046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.066454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.198573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.206164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a69fd2d6-8eb3-41cd-85c7-a6aa55207c29 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1511 microversion: 2.1 time: 0.154681 Sep 01 05:35:25.206716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 239/467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:26.227863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.228474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.234948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.235414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.235838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.236504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.236940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.237348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.447460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.455789 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c8e31beb-5b7b-4bcd-83ba-6737f7862428 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1511 microversion: 2.1 time: 0.231902 Sep 01 05:35:26.456353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 229/468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:26.830173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71532039-11bb-456e-a66d-4d1f916a0c52", "name": "network-vif-deleted", "tag": "3f94d020-4ba5-40ed-b80d-981fc2a45d13"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:26.840131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.843110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.843110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.854890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] Creating event network-vif-deleted:3f94d020-4ba5-40ed-b80d-981fc2a45d13 for instance 71532039-11bb-456e-a66d-4d1f916a0c52 on hv-cinder-85220 Sep 01 05:35:26.860175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d12db9aa-5847-40fe-88bc-778bacd26adc req-03ff22f8-e8f9-467d-a88c-2ce628a82391 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Sep 01 05:35:26.861144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 240/469] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:27.477294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:27.478023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:27.484996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.485543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.486429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.487115 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.487706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.488139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.519073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.519535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.519956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.520388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lazy-loading 'fault' on Instance uuid 71532039-11bb-456e-a66d-4d1f916a0c52 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:27.564556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.573044 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a121384b-7704-4fb3-a099-6bc1c8c7367b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 200 len: 1307 microversion: 2.1 time: 0.099228 Sep 01 05:35:27.573684 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 230/470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:27 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:28.596419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.597098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 71532039-11bb-456e-a66d-4d1f916a0c52] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.603909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.604442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.604888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.605599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.606033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.606440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.620781 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] HTTP exception thrown: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Request method failure captured: Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 HTTP/1.1 Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEQ6QFaorsdjajiZnXXTe2OD-KWUXSISgYxHB49IHcZTGTDi2jW5gWUIAU_2ZDyPqdfz6ubmF3D1Zyp7N7mUUu3yyH2K_PGoBYxY6gVrZwsBiVEQ-2QW--eQ_NGtiNkc9nO2DRCQlFuuChw0YFJbHf13W5dJNo2ucRqno_m7tUzW3sw Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 10dd440ea6f54e0497536117ccba4c9e Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:35:28.622417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10dd440ea6f54e0497536117ccba4c9e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 10dd440ea6f54e0497536117ccba4c9e Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotTestJSON-212844107-project Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b2c0f79be80341a483f02509d774007f Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotTestJSON-212844107-project Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. Sep 01 05:35:28.624027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '71532039-11bb-456e-a66d-4d1f916a0c52'} Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:28.625110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. Sep 01 05:35:28.626814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:28.628219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Returning 404 to user: Instance 71532039-11bb-456e-a66d-4d1f916a0c52 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:28.628219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-50fc3f88-779f-4960-ae40-98b9ad10d384 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52" status: 404 len: 111 microversion: 2.1 time: 0.033048 Sep 01 05:35:28.628219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 241/471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/71532039-11bb-456e-a66d-4d1f916a0c52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:41.132243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1596123253", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "networks": [{"uuid": "49076a23-fce7-4f64-8ab6-a26d8d6b551c"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:41.141488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=49 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:41.142129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=84 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:41.345889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] validate_networks() for [('49076a23-fce7-4f64-8ab6-a26d8d6b551c', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:35:41.693402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:35:41.693915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:35:41.694372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:35:41.694794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:35:41.695193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:35:41.704877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.705339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.705787 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.706492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.706927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.707333 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.725608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Getting quotas for project 10dd440ea6f54e0497536117ccba4c9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:41.730634 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Getting quotas for user b2c0f79be80341a483f02509d774007f and project 10dd440ea6f54e0497536117ccba4c9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:41.741191 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:35:41.743483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:35:41.868249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d2f8e7d6-d5c9-4d5b-ba54-89907c8ce1c6 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739834 Sep 01 05:35:41.868776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 231/472] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:35:41.879667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-211cbeed-4c81-4aae-92e1-e1a81edd9310 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:41.880431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-211cbeed-4c81-4aae-92e1-e1a81edd9310 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:41.882880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:41.883392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:42.043186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-211cbeed-4c81-4aae-92e1-e1a81edd9310 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.050115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-211cbeed-4c81-4aae-92e1-e1a81edd9310 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1219 microversion: 2.1 time: 0.174155 Sep 01 05:35:42.050659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 242/473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:41 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:43.072370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:43.072966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:43.079430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.084196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.084196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.084196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.084196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.084569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.143941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.152264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2cfdc8b0-17df-40ac-b4ac-34aa3e06feaa tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1215 microversion: 2.1 time: 0.084265 Sep 01 05:35:43.152830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 232/474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:43 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:44.172654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:44.173272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:44.179641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.180116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.180539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.181219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.181686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.182362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.264634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.272659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d1cddba1-9d3e-43ef-a9c8-9887c690f84c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1279 microversion: 2.1 time: 0.104467 Sep 01 05:35:44.273222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 243/475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:44 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:45.294365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:45.294911 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:45.301250 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.301761 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.302184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.302857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.303293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.303701 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.452405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.460012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5a071245-de0e-4966-8fc5-6e0e330f88c5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.170255 Sep 01 05:35:45.460571 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 233/476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:45 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:45.763965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c78033-2f2e-42aa-94f4-a8dbffc7fa7d", "tag": "8b8cdbfa-7f76-4562-8042-55ffeb659bf1"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:45.773589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.774055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.774483 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.786472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] Creating event network-changed:8b8cdbfa-7f76-4562-8042-55ffeb659bf1 for instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d on hv-cinder-85220 Sep 01 05:35:45.791390 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-ef7969ab-353e-44b3-9379-96aa26d159ac req-a09d2217-59b5-4330-8bc4-2b0361adeb69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Sep 01 05:35:45.791966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 244/477] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:46.482008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:46.482607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:46.489047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.489622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.490045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.490747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.491181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.491588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.623701 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.631283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6c5ffdcf-c65f-4182-85c9-9af81f391af3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.153960 Sep 01 05:35:46.631836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 234/478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:46 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:47.653349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:47.654112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:47.660611 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.661089 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.661549 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.662241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.662683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.663099 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.801337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.810221 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-75e4be0f-ad7f-4ba4-8e0b-779161c21ade tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.161833 Sep 01 05:35:47.810778 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 245/479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:47 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:48.830420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:48.831026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:48.837466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.837968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.838397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.839076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.839524 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.840582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.971504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.979088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ec0b622d-cf05-4e1f-9b1b-eb8815b0e5eb tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.152502 Sep 01 05:35:48.979712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 235/480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:48 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:50.001248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:50.005928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:50.007839 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.008317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.008751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.009436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.009909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.010320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.190996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.198558 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a9c5ef6f-3cee-436c-9b8f-711ae9ede4f3 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.202157 Sep 01 05:35:50.199180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 246/481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:49 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:51.220453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:51.221137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:51.227416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.227896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.228319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.229049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.229444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.234960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.368573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.376565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-aa7a4bba-d6a0-44d0-a45a-9c3eaf70281e tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.160174 Sep 01 05:35:51.377119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 236/482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:51 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:52.398351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:52.398948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:52.400951 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:52.405889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.406405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.406824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.407520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.407956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.408366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.536303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:52.544252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b246ebb4-69cd-4157-8ca5-ce369bd56fa1 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.149629 Sep 01 05:35:52.544818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 247/483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:52 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:52.990862 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c78033-2f2e-42aa-94f4-a8dbffc7fa7d", "name": "network-vif-plugged", "status": "completed", "tag": "8b8cdbfa-7f76-4562-8042-55ffeb659bf1"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:52.995784 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:52.999699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:53.002322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.002794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.003215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.014857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] Creating event network-vif-plugged:8b8cdbfa-7f76-4562-8042-55ffeb659bf1 for instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d on hv-cinder-85220 Sep 01 05:35:53.019804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-cb6374a3-d88f-4360-ae8f-c1a239ec90bf req-4a440e78-3650-4b29-9b74-d48f69acff2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Sep 01 05:35:53.020387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 237/484] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:53.565333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:53.565997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:53.572275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.572750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.573205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.573911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.574385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.574837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.703388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:53.711022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3e14450c-0a29-4331-85e5-a45d2c77867c tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.150204 Sep 01 05:35:53.716930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 248/485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:53 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:54.733216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:54.733947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:54.741131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.741648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.742085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.742763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.743210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.743656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.871033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.878835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a22c39a1-db00-4347-8ebd-5a2750a15f59 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.150347 Sep 01 05:35:54.879395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 238/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:54 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:55.899277 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.899899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.907068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.907584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.908446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.909137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.909608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.910024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.302333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.310230 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a7737d3f-444a-44e0-9704-bbe6e520c607 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1319 microversion: 2.1 time: 0.414935 Sep 01 05:35:56.310793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 249/487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:55 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:57.330792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:57.331395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:57.337885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.338361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.338790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.339471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.339927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.340437 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.465988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.473933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f3637fc7-ee45-4ef4-9f22-a891f1087f0b tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1508 microversion: 2.1 time: 0.146957 Sep 01 05:35:57.474489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 239/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:57 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:57.494410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b956cd77-3286-40b7-a73a-534c301f7426", "device": "/dev/sdb"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:57.498179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:57.503997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.504460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.504875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.505573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.506007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.506412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:58.266226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6477dd1d-961a-4bca-a19d-3fc91c1c6070 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "POST /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775460 Sep 01 05:35:58.267103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 250/489] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:35:57 2022] POST /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:19.438962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:19.439687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=46 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:19.541043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6909bea-32d4-493d-8914-c89413016376"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:19.543462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.549394 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.549918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.550343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.551021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.551463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.551877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.351943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-972faef1-4430-4805-9bab-131dcfe949d9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918377 Sep 01 05:36:20.353262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 240/490] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:36:19 2022] POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:23.462265 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:23.462836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:23.465398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=20 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:23.467088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:36:23.467219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d/os-volume_attachments/b956cd77-3286-40b7-a73a-534c301f7426 (ip 10.222.0.42) !!! Sep 01 05:36:23.468121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:23.474877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.475349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.475769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.476448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.476885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.477294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.561728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lazy-loading 'services' on Instance uuid 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:23.770587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a03cbaab-eed5-424b-9f6f-cca0eb3187e4 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "DELETE /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d/os-volume_attachments/b956cd77-3286-40b7-a73a-534c301f7426" status: 202 len: 0 microversion: 2.1 time: 0.312260 Sep 01 05:36:23.771222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 251/491] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:36:23 2022] DELETE /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d/os-volume_attachments/b956cd77-3286-40b7-a73a-534c301f7426 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:28.926302 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:28.928613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.936108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.941508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.941508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.941508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.941508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.941889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.961510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'flavor' on Instance uuid 00236455-7aae-4c06-8082-7170ff2908bd {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:29.283703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4b790192-bcdd-438c-9105-4d596e15f1c4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/action" status: 200 len: 32 microversion: 2.1 time: 0.361810 Sep 01 05:36:29.284229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 241/492] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:36:28 2022] POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:36:29.294472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.295225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:29.301414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.301929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.302354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.303035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.303538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.303957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.440684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:29.449633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19bd4876-baae-4b5a-919a-bbbb7503bf82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.159296 Sep 01 05:36:29.453730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 252/493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:29 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:30.181134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:30.181737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.188998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.189486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.189910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.190583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.191022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.191430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.216764 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:36:30.473368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:30.474011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.480491 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.481095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.481640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.482906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.483403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.483922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.508082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-309b3eba-f5a2-4525-83c3-e7464f3df5c7 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "DELETE /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 204 len: 0 microversion: 2.1 time: 0.331378 Sep 01 05:36:30.508770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 242/494] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:30 2022] DELETE /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:36:30.517139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:30.517863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.524145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.524911 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.525337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.526616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.527153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.527584 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.668274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.677735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d65783f2-31cc-4f46-b9a6-1c11cd08f32e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.208381 Sep 01 05:36:30.678362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 253/495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:30 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:30.699895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.708410 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0fa12e21-0144-4011-9546-e6c8c6d4a1b5 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1514 microversion: 2.1 time: 0.195285 Sep 01 05:36:30.708996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 243/496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:30 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:31.698909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:31.699496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:31.706178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.706646 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.707065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.707735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.708176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.708582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.731843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:31.733159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:31.739365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.739839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.740263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.740945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.741384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.741827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.913542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.917382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.922082 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b643d147-32aa-4ce3-8e78-03f78ba85b35 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.227002 Sep 01 05:36:31.922656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 254/497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:31 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:31.928943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-28e061ca-6eac-498f-87e4-086e4570e169 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1514 microversion: 2.1 time: 0.197878 Sep 01 05:36:31.928943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 244/498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:31 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:32.943723 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.944715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.946154 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.947213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.952196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.952744 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.954020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.954020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.954338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.954486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.954782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.954929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.955233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.956103 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.956547 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.956952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.219499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.227665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7615b92c-1978-4a2f-becc-e0a6482a01c2 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.288030 Sep 01 05:36:33.228237 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 255/499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:33.245162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.254804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4082c9cd-6718-4b50-8f74-69b7b236c36d tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1514 microversion: 2.1 time: 0.312460 Sep 01 05:36:33.255578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 245/500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:33.561704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c78033-2f2e-42aa-94f4-a8dbffc7fa7d", "name": "network-vif-deleted", "tag": "8b8cdbfa-7f76-4562-8042-55ffeb659bf1"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:33.571015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.574634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.574634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.582865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] Creating event network-vif-deleted:8b8cdbfa-7f76-4562-8042-55ffeb659bf1 for instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d on hv-cinder-85220 Sep 01 05:36:33.587991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-2cb0dbd3-350a-45a5-9d10-c143ab54be8a req-a0d98c16-9241-4a3b-a19a-d281971e8b35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087540 Sep 01 05:36:33.588559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 256/501] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:34.249348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.249909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.256188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.256658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.257074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.257765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.258204 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.258612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.278802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.279530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.286276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.286891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.287316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.287991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.288434 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.288847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.320020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.320559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.320985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.321416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lazy-loading 'fault' on Instance uuid 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:34.381413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c0f79be80341a483f02509d774007f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dd440ea6f54e0497536117ccba4c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.389923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b556c6e9-8bdd-4591-8073-0d45f2ddb037 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 200 len: 1309 microversion: 2.1 time: 0.114838 Sep 01 05:36:34.390696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 257/502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:34.411973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.420483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1467267b-5b47-4647-b29c-277100f8a92a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.174763 Sep 01 05:36:34.421499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 246/503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:35.410698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:35.411318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] [instance: 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:35.417702 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.418177 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.418601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.419274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.419713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.420229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.433729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] HTTP exception thrown: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Request method failure captured: Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d HTTP/1.1 Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEQ6QFaorsdjajiZnXXTe2OD-KWUXSISgYxHB49IHcZTGTDi2jW5gWUIAU_2ZDyPqdfz6ubmF3D1Zyp7N7mUUu3yyH2K_PGoBYxY6gVrZwsBiVEQ-2QW--eQ_NGtiNkc9nO2DRCQlFuuChw0YFJbHf13W5dJNo2ucRqno_m7tUzW3sw Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 10dd440ea6f54e0497536117ccba4c9e Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:35.435620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10dd440ea6f54e0497536117ccba4c9e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10dd440ea6f54e0497536117ccba4c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 10dd440ea6f54e0497536117ccba4c9e Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-212844107 Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotTestJSON-212844107-project Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b2c0f79be80341a483f02509d774007f Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotTestJSON-212844107-project Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. Sep 01 05:36:35.439125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '99c78033-2f2e-42aa-94f4-a8dbffc7fa7d'} Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:35.439990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. Sep 01 05:36:35.441734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:35.442923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] Returning 404 to user: Instance 99c78033-2f2e-42aa-94f4-a8dbffc7fa7d could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:35.442923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e0f2d5d6-d6f6-4ebf-9058-50b3a664fd10 tempest-VolumesSnapshotTestJSON-212844107 tempest-VolumesSnapshotTestJSON-212844107-project] 10.222.0.42 "GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d" status: 404 len: 111 microversion: 2.1 time: 0.031048 Sep 01 05:36:35.442923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 258/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:35 2022] GET /compute/v2.1/servers/99c78033-2f2e-42aa-94f4-a8dbffc7fa7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:35.445320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:35.446326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:35.453354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.453972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.454564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.455550 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.456010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.456426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.591709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.600760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-263349d9-f65a-4cd7-be7e-0c92b024af82 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.160205 Sep 01 05:36:35.601337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 247/505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:35 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:36.624903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:36.625539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:36.632011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.632467 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.632895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.633596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.634038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.634448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.766667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.775076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-12e6998c-55c2-4927-9352-6df2cd433515 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.154666 Sep 01 05:36:36.775630 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 259/506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:36 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:37.796050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:37.796651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:37.803106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.803581 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.804009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.804681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.805131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.805577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.934948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:37.943719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0b94e21c-b469-4f5b-8bd4-7e64ee8e797a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.151724 Sep 01 05:36:37.944279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 248/507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:37 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:38.965502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:38.966088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:38.973232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.973743 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.974164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.974836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.975272 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.975679 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:39.107370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:39.116321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c5e92f68-e5ef-44b6-8149-d61f314ef1b5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.154683 Sep 01 05:36:39.116879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 260/508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:38 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:40.137314 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:40.137963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:40.145091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.145600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.146042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.146716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.147163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.147599 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.276348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.285529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0096ed67-2e97-4603-b0f2-f445f8c32db5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.152112 Sep 01 05:36:40.286092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 249/509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:40 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:41.306740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:41.307338 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:41.314869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.315340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.315761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.316438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.316874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.317282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.443775 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.452660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-af831712-d282-416c-b3fa-10a41d3d789e tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.149728 Sep 01 05:36:41.453226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 261/510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:41 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:42.473398 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:42.474004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:42.480447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.480920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.481343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.482049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.482493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.483558 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.619546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:42.627635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1ec34b4d-2688-483b-a936-a341462be86b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.158018 Sep 01 05:36:42.628200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 250/511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:42 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:43.649477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:43.650073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:43.656564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.657030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.657448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.658138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.658580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.659007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.788817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.797541 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-097d3695-c073-43ba-b4cb-e5ade29985dd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.151845 Sep 01 05:36:43.798701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 262/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:43 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:44.821533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:44.822166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:44.829087 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.829590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.830018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.830696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.831139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.831554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.850424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:44.963625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:44.971893 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e16c8ad6-3f26-4203-bf60-5551fadbf2cf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.154267 Sep 01 05:36:44.972459 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 251/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:44 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:45.992924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:45.993619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:46.000114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.000592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.001035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.001936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.002386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.002800 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.143957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.152233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-005661a3-7a62-4147-b7f4-3afd02bed500 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.163683 Sep 01 05:36:46.152790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 263/514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:45 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:47.174362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:47.174900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:47.181895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.182371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.182794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.183469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.183913 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.184324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.327124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.335413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0d9edf67-7cc9-48b6-b579-7c16dc65f04b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.165598 Sep 01 05:36:47.335980 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 252/515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:47 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:48.265704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.266220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.272093 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.272564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.272974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.273689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.274126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.274532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.355661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lazy-loading 'services' on Instance uuid 9ed02a46-8470-424b-a900-23405ff45d0c {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:48.356235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.358826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.363572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.364047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.364434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.365139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.365612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.366033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.547840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.556716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5329e63e-c6e6-4934-a85f-4a6554c30e53 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.204253 Sep 01 05:36:48.569567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 253/516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:48 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:48.593674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a842539c-be92-4a37-8dd5-2148530ee88a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments/58892867-9cc1-4861-a367-c64564b55bf0" status: 202 len: 0 microversion: 2.1 time: 0.433717 Sep 01 05:36:48.596252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 264/517] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:36:48 2022] DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments/58892867-9cc1-4861-a367-c64564b55bf0 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:49.578051 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:49.578646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:49.581044 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:49.585730 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.586198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.586621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.587290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.587726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.588134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.724827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:49.734773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bbed0ebc-3695-415b-b4ca-869beba88706 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.160309 Sep 01 05:36:49.735131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 254/518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:49 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:50.756409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:50.757105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:50.763196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.763674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.764612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.765388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.765873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.766287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.896135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.904439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2626991c-2a03-41fa-a3cd-81f7386e0307 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.152659 Sep 01 05:36:50.905156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 265/519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:50 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:51.926367 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:51.926885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:51.933424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.934000 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.934423 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.935109 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.935819 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.936329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.062673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.070875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-74e3f11c-48f4-440b-91c0-f0f8d2178d9c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.148409 Sep 01 05:36:52.071437 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 255/520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:51 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:53.093144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:53.093839 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:53.100084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.100580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.100996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.101698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.102136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.102543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.233025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:53.241291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9bcc1d5d-5177-47c8-bac9-bf0f19f72722 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.152792 Sep 01 05:36:53.241876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 266/521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:53 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:54.267468 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:54.267468 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:54.270891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.271540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.271972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.274081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.274540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.274960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.408405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.416643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-78edc383-f50a-40ff-b844-ccc928b502bd tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1733 microversion: 2.1 time: 0.157387 Sep 01 05:36:54.417200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 256/522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:54 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:55.437927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.438620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.441236 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=35 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:55.446030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.446519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.446945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.447668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.448116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.448530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.452929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:55.650394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:55.659259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4a9f6a64-e537-4c3f-a714-99dcb56933e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1713 microversion: 2.1 time: 0.225502 Sep 01 05:36:55.661379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 267/523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:55 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1713 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:55.722098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.722634 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.729640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.736235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.736235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.736235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.736235 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.737490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.863518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] HTTP exception thrown: Cannot 'detach_volume' instance 00236455-7aae-4c06-8082-7170ff2908bd while it is in vm_state rescued Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Request method failure captured: Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments/e6909bea-32d4-493d-8914-c89413016376 HTTP/1.1 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOTilPmjLHUpc35T_H93PzmVCOJ8fwmm3-rr34RiGHnBn665patDoOtYLkcXOBRcitkamnlR6GUvghNmh6dvzlvOZu2SwKmE32HBvjZFbFf82zRYYuwi4rO3RnXXsKLtzL_ltpMUmBSRzgOIfIEgSVEPgEn9zahOijYyY11Z37fGf0 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:36:55.865108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdbdacacad0f48c6a9238643e67ac6eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: fb50b15e44814c6b82b2a75e3c74de0a Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:36:55.866695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Cannot 'detach_volume' instance 00236455-7aae-4c06-8082-7170ff2908bd while it is in vm_state rescued Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'server_id': '00236455-7aae-4c06-8082-7170ff2908bd', 'id': 'e6909bea-32d4-493d-8914-c89413016376'} Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00236455-7aae-4c06-8082-7170ff2908bd in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:55.870796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 00236455-7aae-4c06-8082-7170ff2908bd while it is in vm_state rescued Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 00236455-7aae-4c06-8082-7170ff2908bd while it is in vm_state rescued Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.872381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Returning 409 to user: Cannot 'detach_volume' instance 00236455-7aae-4c06-8082-7170ff2908bd while it is in vm_state rescued {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:55.873542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bbde3505-82f9-49d1-9550-354aa48673c7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments/e6909bea-32d4-493d-8914-c89413016376" status: 409 len: 152 microversion: 2.1 time: 0.149793 Sep 01 05:36:55.873542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 257/524] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:36:55 2022] DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments/e6909bea-32d4-493d-8914-c89413016376 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:36:55.876224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:55.876754 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.882716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.883320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.883752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.884481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.884930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.885342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.118017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-277e5e1f-599d-4711-86ce-12ae45235504 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/action" status: 202 len: 0 microversion: 2.1 time: 0.246168 Sep 01 05:36:56.118728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 268/525] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:36:55 2022] POST /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:36:56.127681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:56.128284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:56.135378 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.135853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.136284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.136962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.137405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.137850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.267291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:56.275562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cc93d1a4-1bfb-4968-91c4-2c984e9206c5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1721 microversion: 2.1 time: 0.152603 Sep 01 05:36:56.276166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 258/526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:56 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:57.123300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:57.129873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.130350 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.130769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.153607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Going to try to stop instance {{(pid=121031) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:36:57.296303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:57.297737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:57.304259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.304731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.305151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.305929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.306370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.306778 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.369321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ed8b26c5-5ee5-4775-a25b-7c8a89282dd0 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.250750 Sep 01 05:36:57.370227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 269/527] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:36:57 2022] POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:57.379072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:57.380942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:57.388686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.390383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.390978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.392290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.393228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.393923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.514015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.522753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d657dc01-ef08-43ac-b663-0f9ae34bcb88 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1721 microversion: 2.1 time: 0.230189 Sep 01 05:36:57.523256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 259/528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:57 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:57.562222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.571166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-40fcd9c2-0209-4032-afe9-6e289b940368 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.196417 Sep 01 05:36:57.571759 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 270/529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:57 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:58.544315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:58.544865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:58.552018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.552489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.552923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.553631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.554069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.554474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.592415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:58.593376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:58.599223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.599705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.600164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.600853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.601298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.601734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.734021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.742450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-67bc8da0-cac4-4a4d-938e-d8bb3c337e51 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1721 microversion: 2.1 time: 0.202073 Sep 01 05:36:58.743019 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 260/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:58 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:58.763441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.771311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b6c3d6a6-b7d2-4c8a-b68e-179882934079 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.183079 Sep 01 05:36:58.771865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 271/531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:58 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:59.764913 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:59.765590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:59.772144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.772619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.773047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.773831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.774279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.774692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.792237 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:59.792864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:59.800083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.800554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.800975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.801799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.802243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.802652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.962354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:59.971241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b433aeb8-9619-4acf-b3bd-a486bc3714a5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1721 microversion: 2.1 time: 0.210648 Sep 01 05:36:59.971815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 261/532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:59 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:59.987072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:59.994833 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3fe247e-0a7b-476f-adce-e4c8cda03eec tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.206526 Sep 01 05:36:59.995389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 272/533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:59 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:00.993835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:00.994379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:01.001606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.002089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.002536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.003216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.003679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.004097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.016384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:01.017651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:01.024963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.026304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.026734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.027480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.027919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.028338 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.209771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.213594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.219184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1311be34-28a7-4cd8-94c5-8a32876ca78a tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1727 microversion: 2.1 time: 0.229201 Sep 01 05:37:01.219759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 262/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:00 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:01.221972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6a3e42fd-53d6-4532-bea8-2c30fadc1c15 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.210357 Sep 01 05:37:01.222521 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 273/535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:01 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:01.239350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:01.239866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:01.245992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.246409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.246836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.247570 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.248017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.248435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.326434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4b3fc938-11ad-43e4-8a02-2d353be42cdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090779 Sep 01 05:37:01.327543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 263/536] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:37:01 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:02.243046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:02.243716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:02.250864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:02.251411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:02.251928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:02.252581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:02.253018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:02.253424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:02.458004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:02.465979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-854eb525-868a-4218-af50-58dd26905586 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.226812 Sep 01 05:37:02.466544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 274/537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:02 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:02.624452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:02.657834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:02.658300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:02.662834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:02.683866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] Creating event network-changed:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:37:02.690145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-18a8465c-8861-42f9-a8a8-24d074d7e450 req-88176876-1c07-48e6-99be-ec362759b349 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070377 Sep 01 05:37:02.692830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 264/538] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:03.488035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:03.488678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:03.494723 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.495203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.495761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.496444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.496895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.497312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.630014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:03.637657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2b96fbe1-a32b-46d6-baca-6f7a883f4135 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.154738 Sep 01 05:37:03.638212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 275/539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:03 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:04.660224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:04.660918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:04.667290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:04.667769 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:04.668199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:04.668873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:04.669315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:04.669758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:04.706791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:04.716907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:04.724131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:04.724131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:04.731375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] Creating event network-changed:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:37:04.737024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-69d045b4-d8fd-4a90-922f-7390aaf743d9 req-5c6205c7-91f3-43b9-a177-6e26bcd84203 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033809 Sep 01 05:37:04.737648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 276/540] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:04.814800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.822721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6504b45e-8d62-4b57-9e92-0b54c772ec68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.167969 Sep 01 05:37:04.823288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 265/541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:04 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:05.846248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:05.846957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:05.852983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.853546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.853915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.854605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.855047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.855462 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.996296 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.003043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fa819c3b-3f96-4e8c-94ed-47efb3579a63 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.162568 Sep 01 05:37:06.003598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 277/542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:05 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:07.023972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:07.024522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:07.032173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.032661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.033088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.033850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.034296 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.034719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.168349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.176140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5a6a8cb8-997a-414a-a0f9-13e2993ce866 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.156138 Sep 01 05:37:07.176706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 266/543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:07 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:08.197689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:08.198334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:08.205048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:08.205547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:08.205967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:08.206634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:08.207068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:08.207473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:08.335251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:08.343548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aa632d43-324b-492d-aa46-15d626464834 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.149588 Sep 01 05:37:08.349569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 278/544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:08 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:09.364595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:09.365174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:09.371276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.371747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.372167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.372838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.373274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.373846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.503455 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.511297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7f1f1e96-1d1c-41f2-b9ae-add1a4646583 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.150528 Sep 01 05:37:09.511874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 267/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:09 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:10.532355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:10.532947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:10.539450 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.539922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.540348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.541056 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.541522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.541940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.669736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.677631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e688699-98fa-4b87-987d-afe3632b8199 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.149198 Sep 01 05:37:10.679081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 279/546] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:10 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:11.698407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:11.699010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:11.706191 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.708236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.708236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.708236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.708236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.708622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.837548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.845333 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-08ac3357-6fe1-4260-b082-6c9ace7db098 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.150798 Sep 01 05:37:11.845923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 268/547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:11 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:12.866156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:12.866785 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:12.873212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.873720 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.874200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.874878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.875944 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.876362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.011145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.019233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9725fade-32a1-41a7-9a6d-9e10be18cb70 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1676 microversion: 2.1 time: 0.156968 Sep 01 05:37:13.022062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 280/548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:12 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:14.040177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.040696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.047364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.047889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.048310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.048985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.049422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.049858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.053955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:14.177224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.184772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-88f614b2-2316-4f2b-9976-1de6fb181f0e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1653 microversion: 2.1 time: 0.148475 Sep 01 05:37:14.185990 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 269/549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1653 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:14.206510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:14.212869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.213338 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.213792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.235868 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Going to try to start instance {{(pid=121031) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:37:14.258379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:14.438373 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-be96ea97-7f1b-49e9-a7c5-d336696d6a83 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.235800 Sep 01 05:37:14.439225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 281/550] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:37:14 2022] POST /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:14.447328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.447927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.453949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.454564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.454997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.455673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.456113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.456518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.591901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.600078 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-19c0e59b-c6ed-4d06-bf64-4768d4f9cb8a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1662 microversion: 2.1 time: 0.156512 Sep 01 05:37:14.600637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 270/551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:15.622704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:15.623507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:15.630984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.631442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.631866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.632532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.632968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.633374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.770602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:15.778583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f840ba23-9001-4b54-9c92-d7a78aa32db2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1662 microversion: 2.1 time: 0.160517 Sep 01 05:37:15.779160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 282/552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:15 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:16.800546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:16.801145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:16.807570 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.808041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.808462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.809130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.809608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.810020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.937516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:16.945301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1ec35806-8388-4fab-982d-b2eb9129013e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1666 microversion: 2.1 time: 0.149156 Sep 01 05:37:16.945895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 271/553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:16 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:22.353174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.353688 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.359585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.360055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.360477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.361186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.361671 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.362167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.385291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e1faeb4b-4435-4526-b313-a058fc056257 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/ips" status: 200 len: 148 microversion: 2.1 time: 0.256493 Sep 01 05:37:22.385863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 283/554] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:37:22 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/ips => generated 148 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:37:22.398942 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a4a7bc3-d642-46c6-a8cd-634fc000d893"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:22.401209 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.403782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=36 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:22.408603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.411021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.411021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.411021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.411021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.411375 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.490723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: POST /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/os-volume_attachments HTTP/1.1 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 74 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:37:22.492477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {"volumeAttachment": {"volumeId": "1a4a7bc3-d642-46c6-a8cd-634fc000d893"}} Sep 01 05:37:22.494017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'server_id': '5d790d97-9608-4cc6-a1a6-52511c16036c', 'body': {'volumeAttachment': {'volumeId': '1a4a7bc3-d642-46c6-a8cd-634fc000d893'}}} Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:22.494806 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:22.496192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 400 to user: Invalid volume: volume 1a4a7bc3-d642-46c6-a8cd-634fc000d893 is already attached to instances: 2bedbeaf-c165-4774-b947-dd14b08dcb67 {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-72e3857c-aaea-489d-941f-c66059a07ffa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098987 Sep 01 05:37:22.497609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 272/555] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:37:22 2022] POST /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:37:22.503522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.504007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.509988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.510463 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.510889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.511564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.512010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.512426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.537975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:37:22.801870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1ae8b19a-01b4-4671-90ed-d63e82330c34 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 204 len: 0 microversion: 2.1 time: 0.302491 Sep 01 05:37:22.802457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 284/556] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:37:22 2022] DELETE /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:37:22.812275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.812870 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.820713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.821188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.821705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.822384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.822826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.823239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.954362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:22.962092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4b229cf7-02eb-4ab2-9ab3-f1cd007550bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1680 microversion: 2.1 time: 0.153950 Sep 01 05:37:22.962649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 273/557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:22 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:23.983875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:23.984504 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:23.990991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.991454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.991869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.992557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.992974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.993377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:24.125912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:24.133937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-99f485c9-5805-473d-b921-b963af1bb41e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1680 microversion: 2.1 time: 0.154320 Sep 01 05:37:24.134493 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 285/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:23 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:25.155658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:25.156255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:25.163833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.164307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.164735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.165414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.165887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.166299 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.403601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:25.411474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-21edf864-db2c-4411-8f0e-c3cbe91e4997 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1680 microversion: 2.1 time: 0.259576 Sep 01 05:37:25.417371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 274/559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:25 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:25.896288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d790d97-9608-4cc6-a1a6-52511c16036c", "name": "network-vif-deleted", "tag": "40edf63a-12a7-4c65-b315-d1f488a96671"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:25.901369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:25.906601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.907076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.907499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.918823 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] Creating event network-vif-deleted:40edf63a-12a7-4c65-b315-d1f488a96671 for instance 5d790d97-9608-4cc6-a1a6-52511c16036c on hv-cinder-85220 Sep 01 05:37:25.923709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-e21d340b-b940-46c4-ac0e-1260bbd3c90c req-facd37f6-d4ef-462e-8180-ef857c7f28b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 Sep 01 05:37:25.925125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 286/560] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:37:26.433346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:26.434609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:26.443422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:26.444201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:26.445092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.446434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:26.447083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:26.448225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.487662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:26.488144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:26.488572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.489016 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'fault' on Instance uuid 5d790d97-9608-4cc6-a1a6-52511c16036c {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:37:26.793009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:26.801816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f4b6b357-3c5a-43eb-8a91-5edb09a51205 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 200 len: 1331 microversion: 2.1 time: 0.373276 Sep 01 05:37:26.802411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 275/561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:26 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 1331 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:27.823911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:27.824525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:27.831764 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.832251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.832667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.833342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.833810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.836783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.847526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c HTTP/1.1 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:37:27.849259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:37:27.850855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '5d790d97-9608-4cc6-a1a6-52511c16036c'} Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:37:27.851968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:37:27.853622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:37:27.855361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:37:27.855361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c114bd72-0535-4bdd-8f0b-3aec79f02e6a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 404 len: 111 microversion: 2.1 time: 0.031919 Sep 01 05:37:27.855361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 287/562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:27 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:37:27.860566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bc189c04-0cb9-46c2-9a18-9663a6fa7eb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '.version_select at 0x7fbb6b9b4700>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:27.973717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bc189c04-0cb9-46c2-9a18-9663a6fa7eb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498283298" status: 202 len: 0 microversion: 2.1 time: 0.116808 Sep 01 05:37:27.974425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 276/563] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 1 05:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498283298 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:28.792395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:28.792885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:28.799088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.799561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.800136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.800841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.801283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.801722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.881712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'services' on Instance uuid 2bedbeaf-c165-4774-b947-dd14b08dcb67 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:37:29.079356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-95f5a906-97c8-4549-9227-2f07b39e3849 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments/1a4a7bc3-d642-46c6-a8cd-634fc000d893" status: 202 len: 0 microversion: 2.1 time: 0.290993 Sep 01 05:37:29.079986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 288/564] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:37:28 2022] DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments/1a4a7bc3-d642-46c6-a8cd-634fc000d893 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:29.090357 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:29.092671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:29.103354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.103837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.104266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.104961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.105409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.105853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.135513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9e15a2c3-e631-4fdc-9d5e-b29d8db8d60a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049883 Sep 01 05:37:29.136063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 277/565] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:37:29 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:30.149344 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:30.151689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:30.157806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.158275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.158749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.160012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.160451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.160865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.190227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5a8cc038-052e-4892-8971-4d90e78030bc tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Sep 01 05:37:30.191018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 289/566] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:37:30 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:31.202605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:31.204743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:31.211468 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.211936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.212358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.213022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.213479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.213894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.242900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ec1545dc-c697-49ab-86c7-914a02b8ad83 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044205 Sep 01 05:37:31.243450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 278/567] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:37:31 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:37:31.304227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:31.304745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:31.311069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.311536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.312216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.312885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.313322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.313755 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.339521 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:37:31.623361 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-887b06fe-d17f-4694-b1f1-347283db87de tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 204 len: 0 microversion: 2.1 time: 0.323256 Sep 01 05:37:31.623942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 290/568] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:37:31 2022] DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:37:31.632168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:31.632922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:31.638993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.639466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.639894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.640568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.641012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.641428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.774485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:31.782155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2e7df4d5-e979-4c35-9955-400b38144d47 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1679 microversion: 2.1 time: 0.154083 Sep 01 05:37:31.782714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 279/569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:31 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:32.804719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:32.805405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:32.812673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.813153 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.813613 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.818705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.818705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.818705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.027474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:33.036052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d0204b69-2184-4e57-9af3-833e18cf3eab tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1679 microversion: 2.1 time: 0.235766 Sep 01 05:37:33.036622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 291/570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:32 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:33.682748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bedbeaf-c165-4774-b947-dd14b08dcb67", "name": "network-vif-deleted", "tag": "4163992e-a815-4b35-a6b7-0bc2d7c7b1c1"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:33.693304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:33.699138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:33.699138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.705622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] Creating event network-vif-deleted:4163992e-a815-4b35-a6b7-0bc2d7c7b1c1 for instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 on hv-cinder-85220 Sep 01 05:37:33.712032 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-88f7a5c8-beda-426d-a525-34cf71f41a3c req-fc64bccd-c31f-4651-afd9-42ea0e0ff035 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032247 Sep 01 05:37:33.713603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 280/571] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:34.060330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:34.060938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:34.068535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.069018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.069695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.070581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.071024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.071441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.109050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.109563 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.109997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.110440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'fault' on Instance uuid 2bedbeaf-c165-4774-b947-dd14b08dcb67 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:37:34.154337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:34.163575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f9c64f2b-a76c-4436-b3f2-065eb5c5c189 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 200 len: 1330 microversion: 2.1 time: 0.107366 Sep 01 05:37:34.164134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 292/572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:34 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:35.185878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:35.186562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:35.193026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.193521 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.193944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.194612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.195047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.195452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.208393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 HTTP/1.1 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:37:35.210009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:37:35.211636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '2bedbeaf-c165-4774-b947-dd14b08dcb67'} Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:37:35.212479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:37:35.213916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:37:35.215211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:37:35.215211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7537d746-4d7c-4ed8-a1cf-47ab9068dbd8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 404 len: 111 microversion: 2.1 time: 0.030268 Sep 01 05:37:35.215211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 281/573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:35 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:37:35.220231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-659d5c9d-ae69-450d-9ae0-341471897f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '.version_select at 0x7fbb6b9bd040>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:35.225498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR oslo.messaging._drivers.impl_rabbit [None req-659d5c9d-ae69-450d-9ae0-341471897f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [98bb360a-bcad-4c33-a8e5-4463334abc12] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:37:36.232589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [None req-659d5c9d-ae69-450d-9ae0-341471897f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [98bb360a-bcad-4c33-a8e5-4463334abc12] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 45212. Sep 01 05:37:36.315998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-659d5c9d-ae69-450d-9ae0-341471897f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299998657" status: 202 len: 0 microversion: 2.1 time: 1.099533 Sep 01 05:37:36.316607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 293/574] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 1 05:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299998657 => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:37.111848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-59a0983d-1528-4387-8209-f4b809922a66 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: .version_select at 0x7fbb6ba43a60>, body: {"keypair": {"name": "tempest-keypair-39288595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENu51YAt3iIp1opvMdBgXdT/L3W2hk9rDO5mUJfIRfOxNPys4KvB3ln2Q+UotJS5whO/Wdywd3CaRcRYQzy8jl0TqlbbHZyR9IA1RhjnyfFCBpH7+QM0rqlVq3t9GtFEg=="}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:37.128071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-59a0983d-1528-4387-8209-f4b809922a66 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:37.132473 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-59a0983d-1528-4387-8209-f4b809922a66 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:37.213211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-59a0983d-1528-4387-8209-f4b809922a66 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.105163 Sep 01 05:37:37.213829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 282/575] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:37:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:39.411174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968871757", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292c4ef4-bb7c-4583-ab02-5307a5a77a17"}], "security_groups": [{"name": "tempest-securitygroup--307773280"}], "key_name": "tempest-keypair-39288595", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:39.513578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] validate_networks() for [('292c4ef4-bb7c-4583-ab02-5307a5a77a17', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:37:39.972097 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:37:39.972509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:37:39.973004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:37:39.973400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:37:39.973829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:37:39.983382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.983856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.984275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.985010 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.985508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.985889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.003021 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:40.007026 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:40.017872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:37:40.020105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:37:40.191396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b2298aa-3c44-4068-a507-6ce4bee68ea2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.784967 Sep 01 05:37:40.191957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 294/576] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:37:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:37:40.204059 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6df8e64f-b189-4257-a118-cf2c2b7d5545 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:40.207677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6df8e64f-b189-4257-a118-cf2c2b7d5545 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:40.264023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6df8e64f-b189-4257-a118-cf2c2b7d5545 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:40.272144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6df8e64f-b189-4257-a118-cf2c2b7d5545 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1240 microversion: 2.1 time: 0.072433 Sep 01 05:37:40.272705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 283/577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:40 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:41.294072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2ca35516-ec60-4937-9292-12a9df8edfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:41.294668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2ca35516-ec60-4937-9292-12a9df8edfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:41.346597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2ca35516-ec60-4937-9292-12a9df8edfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:41.354879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2ca35516-ec60-4937-9292-12a9df8edfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1240 microversion: 2.1 time: 0.065112 Sep 01 05:37:41.355424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 295/578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:41 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:42.375535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:42.376147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:42.383406 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.383885 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.384316 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.384993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.385443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.385887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.449921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:42.457533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-81f96487-2796-44ab-9e70-57a27ec3b040 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1244 microversion: 2.1 time: 0.085811 Sep 01 05:37:42.458094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 284/579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:42 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:43.479407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:43.553489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:43.553489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.553489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.553489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.554567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.554567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.554567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.559121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:43.567380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e3eabc90-3398-4b2b-864c-a0d9f08d243e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1236 microversion: 2.1 time: 0.091989 Sep 01 05:37:43.571185 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 296/580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:43 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:44.588267 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:44.588869 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:44.596485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:44.596968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:44.597394 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.598098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:44.598545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:44.598954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.601732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=71 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:44.679929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:44.687621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-08aa7bdc-a4da-41ed-add8-b31e90c28459 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1300 microversion: 2.1 time: 0.102996 Sep 01 05:37:44.688190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 285/581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:44 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:45.709744 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:45.710336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:45.716984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.717596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.718100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.718797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.719268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.719678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.724884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:45.887198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:45.894865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1d13125f-ce28-4e28-acbc-6e77e1debbde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.189205 Sep 01 05:37:45.895424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 297/582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:45 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:46.210931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6b8455-d438-4f74-add3-da00e0b64d03", "tag": "df3b7a4c-a21a-45a1-926e-48de5643353c"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:46.222196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.222665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.223089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:46.234362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] Creating event network-changed:df3b7a4c-a21a-45a1-926e-48de5643353c for instance 7d6b8455-d438-4f74-add3-da00e0b64d03 on hv-cinder-85220 Sep 01 05:37:46.239397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-c28deb80-7a18-47d1-a29f-9e019aa1c85e req-8ce66d61-5242-48bd-b76e-6dc56e37ea1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037475 Sep 01 05:37:46.240181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 286/583] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:46.916883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:46.917511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:46.923808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.924312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.924753 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:46.925425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.925953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.926364 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:47.069831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:47.077568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c5e88fae-5564-4fcd-a164-236bb158ac78 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.164542 Sep 01 05:37:47.078127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 298/584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:46 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:48.098509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:48.099379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:48.105373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.105879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.106305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.106977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.107417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.107832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.477688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:48.485415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-015b3d45-a590-4a4d-98d7-3c2426f1dbe1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.391562 Sep 01 05:37:48.485995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 287/585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:48 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:49.506860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:49.507482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:49.514788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:49.515635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:49.516379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:49.517614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:49.518391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:49.519117 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:49.649784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:49.657251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-004070de-5c85-4e3b-857a-c97fca055fa2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.155717 Sep 01 05:37:49.657837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 299/586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:49 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:50.678045 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:50.678690 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:50.681119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:50.685846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:50.686315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:50.686736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:50.687412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:50.688141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:50.688556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:50.819705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:50.827277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-666e31a2-7bb7-4140-835e-c51bbd02fb98 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.153269 Sep 01 05:37:50.827833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 288/587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:50 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:51.457391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:51.459157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=8 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:51.519923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6b8455-d438-4f74-add3-da00e0b64d03", "name": "network-vif-plugged", "status": "completed", "tag": "df3b7a4c-a21a-45a1-926e-48de5643353c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:51.530281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:51.530751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:51.531171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:51.543031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] Creating event network-vif-plugged:df3b7a4c-a21a-45a1-926e-48de5643353c for instance 7d6b8455-d438-4f74-add3-da00e0b64d03 on hv-cinder-85220 Sep 01 05:37:51.547970 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-6653dc5c-f4b6-4c59-bcd4-06a18f0623c2 req-e830b232-85f8-4784-ae53-f0e35e098d0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095516 Sep 01 05:37:51.548569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 300/588] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:51.848602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:51.849831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:51.856452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:51.856923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:51.857342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:51.858052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:51.858485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:51.864217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:52.001791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:52.009769 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-de5dedb6-8b73-4734-84cb-3235163121e5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.164912 Sep 01 05:37:52.010434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 289/589] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:51 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:53.032793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:53.033362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:53.040175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:53.040648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:53.041067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:53.041756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:53.042199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:53.042606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:53.174389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:53.181969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-805f6b9b-8132-4bf3-807b-7052cf76c879 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.154275 Sep 01 05:37:53.182532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 301/590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:53 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:54.203279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:54.203864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:54.206176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:54.211086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:54.211630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:54.212062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:54.212788 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:54.213236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:54.213770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:54.348639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:54.356987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-09d096b0-8e63-448e-9c97-7ad1b2ce927e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1365 microversion: 2.1 time: 0.157524 Sep 01 05:37:54.357568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 290/591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:54 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:55.378243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:55.378882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:55.386025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.386506 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.386938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.387629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.388074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.388493 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.517628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:55.525269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e0966547-db71-4032-b267-2a46b076c758 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1554 microversion: 2.1 time: 0.150878 Sep 01 05:37:55.529522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 302/592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:55 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:55.545469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:55.545997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:55.552408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.552886 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.553320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.554034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.554986 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.555540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.632220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c1d3d657-fa28-480f-a96d-054fc718dd5f tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090509 Sep 01 05:37:55.632905 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 291/593] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:37:55 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:37:56.604588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6b8455-d438-4f74-add3-da00e0b64d03", "tag": "df3b7a4c-a21a-45a1-926e-48de5643353c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:56.614798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:56.615267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:56.615692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:56.627423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] Creating event network-changed:df3b7a4c-a21a-45a1-926e-48de5643353c for instance 7d6b8455-d438-4f74-add3-da00e0b64d03 on hv-cinder-85220 Sep 01 05:37:56.632546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-6ec8c492-b7ac-4955-8656-8e4853c5adc7 req-59dd6c2b-1642-48a0-9d97-b90f17bdc5d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Sep 01 05:37:56.633947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 303/594] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:57.583141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:57.583691 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:57.589943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.590427 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.590859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.591545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.591992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.592445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.673644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'services' on Instance uuid 00236455-7aae-4c06-8082-7170ff2908bd {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:37:57.897667 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6c8b9919-9667-4a04-a881-f1a55f4e8757 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments/e6909bea-32d4-493d-8914-c89413016376" status: 202 len: 0 microversion: 2.1 time: 0.318756 Sep 01 05:37:57.898850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 292/595] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:37:57 2022] DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments/e6909bea-32d4-493d-8914-c89413016376 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:57.909797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:57.912403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:57.919250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.919726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.920148 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.921289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.921756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.922177 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.952870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cdc2ad64-4acd-43fc-af98-4c19bdc2c9eb tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Sep 01 05:37:57.953414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 304/596] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:37:57 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:58.965280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:58.967536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:58.974285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:58.977968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:58.977968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:58.977968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:58.977968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:58.978417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:59.007077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cc6ef187-cccd-45af-87c0-2c67497fc0e7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Sep 01 05:37:59.007820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 293/597] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:37:58 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:00.020038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:00.022258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:00.025297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:00.030709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.031528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.032188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.032888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.033387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.052564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.073640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1f1f232b-5903-452a-a100-f6845b3fc846 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057399 Sep 01 05:38:00.074207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 305/598] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:38:00 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:38:00.157476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:00.158320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:00.161620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:38:00.161786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd (ip 10.222.0.42) !!! Sep 01 05:38:00.173368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.174491 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.174491 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.175138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.175595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.176014 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.213054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:00.514514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9046c5b3-4929-4674-84d1-d4dfc24610be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 204 len: 0 microversion: 2.1 time: 0.361166 Sep 01 05:38:00.515097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 294/599] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:00 2022] DELETE /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:00.523012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:00.524558 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:00.531015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.531490 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.531919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.532604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.533049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.533484 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.676991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:00.685284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5a192de9-d338-4970-bd40-6b79a697cea4 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1687 microversion: 2.1 time: 0.166109 Sep 01 05:38:00.685881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 306/600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:00 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:01.708249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:01.708966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:01.716057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:01.716533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:01.716960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:01.717666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:01.718111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:01.718523 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:01.846919 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:01.854835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c5bedb4e-8f7b-4f0b-8ce2-cf425d007150 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1687 microversion: 2.1 time: 0.150776 Sep 01 05:38:01.855382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 295/601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:01 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:02.875213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:02.875826 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:02.882473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:02.886313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:02.886313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:02.886313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:02.886313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:02.886722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:03.010980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:03.018648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d8441262-89eb-40d3-8255-fc1f9e7426be tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1687 microversion: 2.1 time: 0.147320 Sep 01 05:38:03.019430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 307/602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:02 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:04.039781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:04.040423 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:04.046846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:04.047322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:04.047749 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:04.048448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:04.048897 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:04.049304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:04.247492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:04.256443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1b73bb31-6fb9-4482-a073-e9d0b8625ec7 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1687 microversion: 2.1 time: 0.220646 Sep 01 05:38:04.257124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 296/603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:04 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1687 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:05.095112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00236455-7aae-4c06-8082-7170ff2908bd", "name": "network-vif-deleted", "tag": "cbf72fc7-2aed-4374-8c8e-c9a3be9489ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:05.106625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:05.107092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:05.107509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:05.119695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] Creating event network-vif-deleted:cbf72fc7-2aed-4374-8c8e-c9a3be9489ce for instance 00236455-7aae-4c06-8082-7170ff2908bd on hv-cinder-85220 Sep 01 05:38:05.124683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0d798a7f-d02b-4c07-be48-2a09706cbbd1 req-1c1fc944-4019-4044-8119-8894954eac76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Sep 01 05:38:05.125442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 308/604] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:05.278223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:05.278837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:05.289050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:05.289050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:05.289050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:05.289050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:05.289598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:05.289598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:05.357931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:05.365522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f57798ed-08ab-4907-b6bb-8e5e31a3c2aa tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 200 len: 1328 microversion: 2.1 time: 0.091371 Sep 01 05:38:05.366088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 297/605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:05 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:06.387163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:06.387853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 00236455-7aae-4c06-8082-7170ff2908bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:06.394144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:06.394626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:06.395053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:06.395735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:06.396180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:06.396592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:06.410602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] HTTP exception thrown: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Request method failure captured: Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd HTTP/1.1 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOTilPmjLHUpc35T_H93PzmVCOJ8fwmm3-rr34RiGHnBn665patDoOtYLkcXOBRcitkamnlR6GUvghNmh6dvzlvOZu2SwKmE32HBvjZFbFf82zRYYuwi4rO3RnXXsKLtzL_ltpMUmBSRzgOIfIEgSVEPgEn9zahOijYyY11Z37fGf0 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:38:06.414559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdbdacacad0f48c6a9238643e67ac6eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: fb50b15e44814c6b82b2a75e3c74de0a Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. Sep 01 05:38:06.416675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '00236455-7aae-4c06-8082-7170ff2908bd'} Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:06.417441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. Sep 01 05:38:06.418749 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:06.420526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Returning 404 to user: Instance 00236455-7aae-4c06-8082-7170ff2908bd could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:06.420526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e9f492a9-c37a-419c-a41f-9f8dc40025b0 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd" status: 404 len: 111 microversion: 2.1 time: 0.031781 Sep 01 05:38:06.420526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 309/606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:06 2022] GET /compute/v2.1/servers/00236455-7aae-4c06-8082-7170ff2908bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:06.422807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cfd217c8-50a7-446b-b0f6-bf9e2828d167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '.version_select at 0x7fbb6b94a3a0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:06.520996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cfd217c8-50a7-446b-b0f6-bf9e2828d167 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-6957177" status: 202 len: 0 microversion: 2.1 time: 0.101815 Sep 01 05:38:06.521562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 298/607] 10.222.0.42 () {58 vars in 1212 bytes} [Thu Sep 1 05:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-6957177 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:38:09.762456 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:09.762928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:09.769433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:09.769925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:09.770345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:09.771014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:09.771455 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:09.771867 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:09.798428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:10.104761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9bfcab03-e530-458e-9a24-6802e96c65a9 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 204 len: 0 microversion: 2.1 time: 0.345897 Sep 01 05:38:10.105334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 310/608] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:09 2022] DELETE /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:10.113482 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:10.114095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:10.120659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:10.121142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:10.121602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:10.122289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:10.122740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:10.123158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:10.253644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:10.262159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c82f03f1-6232-4cca-89fb-50e85ac1bb32 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1507 microversion: 2.1 time: 0.152695 Sep 01 05:38:10.262718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 299/609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:10 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:11.284654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:11.285313 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:11.292580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:11.294505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:11.294505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:11.294505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:11.294884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:11.295299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:11.437005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:11.445408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9d3bdee8-e959-4dfb-bc31-162ea5af404d tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1507 microversion: 2.1 time: 0.164962 Sep 01 05:38:11.446018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 311/610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:11 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:11.521439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daf7696-f2c7-4c63-b929-03cc743b8ea2", "name": "network-vif-deleted", "tag": "d484bf56-8ee3-4920-858a-0b66b9e65df5"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:11.532486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:11.534992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:11.534992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:11.545134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] Creating event network-vif-deleted:d484bf56-8ee3-4920-858a-0b66b9e65df5 for instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 on hv-cinder-85220 Sep 01 05:38:11.550393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-5ceb277d-46f7-4ff9-aa06-6c168d7d48ff req-05a105d8-51ef-44cb-addf-b5242bd1c6d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032658 Sep 01 05:38:11.551091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 300/611] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:12.467111 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:12.467759 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:12.474468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:12.475132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:12.475417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:12.476102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:12.476582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:12.477005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:12.511554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:12.512036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:12.512980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:12.513505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'fault' on Instance uuid 7daf7696-f2c7-4c63-b929-03cc743b8ea2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:12.558748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:12.567205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-83a01eb9-3207-45a0-b1d9-2178b5007c0c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 200 len: 1311 microversion: 2.1 time: 0.104024 Sep 01 05:38:12.567766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 312/612] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:12 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:13.593817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:13.594503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: 7daf7696-f2c7-4c63-b929-03cc743b8ea2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:13.600722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.601196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.602630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.603276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.603721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.604138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.619653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] HTTP exception thrown: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Request method failure captured: Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 HTTP/1.1 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOTilPmjLHUpc35T_H93PzmVCOJ8fwmm3-rr34RiGHnBn665patDoOtYLkcXOBRcitkamnlR6GUvghNmh6dvzlvOZu2SwKmE32HBvjZFbFf82zRYYuwi4rO3RnXXsKLtzL_ltpMUmBSRzgOIfIEgSVEPgEn9zahOijYyY11Z37fGf0 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:38:13.621185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdbdacacad0f48c6a9238643e67ac6eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: fb50b15e44814c6b82b2a75e3c74de0a Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. Sep 01 05:38:13.622848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '7daf7696-f2c7-4c63-b929-03cc743b8ea2'} Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:13.624011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. Sep 01 05:38:13.625495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:13.626993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Returning 404 to user: Instance 7daf7696-f2c7-4c63-b929-03cc743b8ea2 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:13.626993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b0b3a0a7-6c64-477d-9c5f-6c963a357814 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2" status: 404 len: 111 microversion: 2.1 time: 0.033577 Sep 01 05:38:13.626993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 301/613] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:13 2022] GET /compute/v2.1/servers/7daf7696-f2c7-4c63-b929-03cc743b8ea2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:13.631856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:13.632344 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:13.639194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.639660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.640079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.640745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.641182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.641632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.667370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:13.691920 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:14.013008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-36d94d59-dc29-4a96-b5a8-eddf888150e5 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 204 len: 0 microversion: 2.1 time: 0.384765 Sep 01 05:38:14.013625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 313/614] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:13 2022] DELETE /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:14.021463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:14.022085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:14.028004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:14.028478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:14.028903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:14.029602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:14.030042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:14.030453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:14.401675 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:14.403943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:14.409969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-34bcd441-1d27-40d5-964e-8dff5029903b tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.392308 Sep 01 05:38:14.410526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 302/615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:14 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:15.431288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:15.432006 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:15.438471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:15.439211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:15.439634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:15.440314 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:15.440752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:15.441165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:15.569554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:15.577762 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6e789561-9bcf-42ed-9ee9-bd188d45dcdf tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.150729 Sep 01 05:38:15.578327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 314/616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:15 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:16.598825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:16.599431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:16.606778 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:16.607260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:16.607723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:16.608407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:16.608886 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:16.609302 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:16.739699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:16.748247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2166c76d-1a4e-4846-95d8-6e64ce01dcef tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1521 microversion: 2.1 time: 0.153718 Sep 01 05:38:16.748805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 303/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:16 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:17.298679 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f0b2a5-67bc-4a0b-a725-16a3c66c472d", "name": "network-vif-deleted", "tag": "9c9d109d-5428-4c12-b14a-04e96ba61b6f"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:17.309130 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.309634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.310061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.322610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] Creating event network-vif-deleted:9c9d109d-5428-4c12-b14a-04e96ba61b6f for instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d on hv-cinder-85220 Sep 01 05:38:17.327766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-4444b03b-8094-4361-81a6-da1c668c2a3f req-30c63a47-2d8b-4c54-b262-e1d15e542878 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Sep 01 05:38:17.328807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 315/618] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:17.768740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:17.769376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:17.776930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.777395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.777847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.778586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.779122 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.779529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.812354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.812824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.813247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.813968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lazy-loading 'fault' on Instance uuid b3f0b2a5-67bc-4a0b-a725-16a3c66c472d {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:17.860810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb50b15e44814c6b82b2a75e3c74de0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbdacacad0f48c6a9238643e67ac6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:17.869604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-58f1b7fb-062b-492e-a805-3c01156e015c tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 200 len: 1311 microversion: 2.1 time: 0.104692 Sep 01 05:38:17.870151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 304/619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:17 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:18.890962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:18.891652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] [instance: b3f0b2a5-67bc-4a0b-a725-16a3c66c472d] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:18.898417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:18.898919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:18.899348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:18.900033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:18.900558 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:18.900996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:18.914196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] HTTP exception thrown: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Request method failure captured: Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d HTTP/1.1 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOTilPmjLHUpc35T_H93PzmVCOJ8fwmm3-rr34RiGHnBn665patDoOtYLkcXOBRcitkamnlR6GUvghNmh6dvzlvOZu2SwKmE32HBvjZFbFf82zRYYuwi4rO3RnXXsKLtzL_ltpMUmBSRzgOIfIEgSVEPgEn9zahOijYyY11Z37fGf0 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:38:18.915802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdbdacacad0f48c6a9238643e67ac6eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdbdacacad0f48c6a9238643e67ac6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cdbdacacad0f48c6a9238643e67ac6eb Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1613576578 Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: fb50b15e44814c6b82b2a75e3c74de0a Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1613576578-project Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. Sep 01 05:38:18.917321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'b3f0b2a5-67bc-4a0b-a725-16a3c66c472d'} Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:18.918210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. Sep 01 05:38:18.919674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:38:18.921046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] Returning 404 to user: Instance b3f0b2a5-67bc-4a0b-a725-16a3c66c472d could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:18.921046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0aa17f8c-19fa-41fb-aaba-9ece90b89437 tempest-ServerRescueNegativeTestJSON-1613576578 tempest-ServerRescueNegativeTestJSON-1613576578-project] 10.222.0.42 "GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d" status: 404 len: 111 microversion: 2.1 time: 0.030436 Sep 01 05:38:18.921046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 316/620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:18 2022] GET /compute/v2.1/servers/b3f0b2a5-67bc-4a0b-a725-16a3c66c472d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:38:20.121310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:20.123568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:20.130408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.131432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.131432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.132143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.133132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.133755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.165945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-31eda188-f7ed-42b4-8e88-6678f5d3ca68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049163 Sep 01 05:38:20.172668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 305/621] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:38:20 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:38:20.235311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:20.235895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:20.243093 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.243612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.244112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.244880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.245401 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.245910 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.272485 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:20.516449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-771d6e85-a69c-4eb4-8eb9-5ededc54331b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 204 len: 0 microversion: 2.1 time: 0.284701 Sep 01 05:38:20.520997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 317/622] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:20 2022] DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:20.528892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:20.530352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:20.535777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.536275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.536961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.537861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.538461 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.538919 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.765843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:20.775022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dd0676c6-def1-4818-aaa9-d4e666c2c044 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1672 microversion: 2.1 time: 0.252621 Sep 01 05:38:20.775605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 306/623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:20 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:21.797312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:21.798028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:21.805365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.805882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.806303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.807025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.807463 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.807869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.114052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:22.125032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a2159411-7f87-4183-a21c-d3fbb7dd7350 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1672 microversion: 2.1 time: 0.332178 Sep 01 05:38:22.131269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 318/624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:21 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:23.154731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.157561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.165871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.166363 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.166799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.167661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.168277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.168967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.191253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed02a46-8470-424b-a900-23405ff45d0c", "name": "network-vif-deleted", "tag": "518d51c5-0ec9-4de4-971a-46ed87c7ba5b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:23.203640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.204451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.204937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.221355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] Creating event network-vif-deleted:518d51c5-0ec9-4de4-971a-46ed87c7ba5b for instance 9ed02a46-8470-424b-a900-23405ff45d0c on hv-cinder-85220 Sep 01 05:38:23.226241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-98572232-7eda-483c-8925-93ce4295b9c4 req-f2dfd060-6061-477f-9165-8626175c4647 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038878 Sep 01 05:38:23.227155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 319/625] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:23.266021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:23.275455 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-46e016de-6ee4-48fb-8224-ab1132896f91 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1604 microversion: 2.1 time: 0.126940 Sep 01 05:38:23.276041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 307/626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:23 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1604 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:24.299315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:24.299989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:24.306327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.306795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.307212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.307879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.308318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.308732 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.343402 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.344164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.344587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.345021 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lazy-loading 'fault' on Instance uuid 9ed02a46-8470-424b-a900-23405ff45d0c {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:24.388194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:24.395582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-77b57415-1283-4892-afe5-147c9de32528 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 200 len: 1325 microversion: 2.1 time: 0.100845 Sep 01 05:38:24.396149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 320/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:24 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 1325 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:25.417107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.418034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:25.420662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:25.425526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.426126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.426687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.427626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.428220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.428813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.443244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c HTTP/1.1 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:38:25.444795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:38:25.446759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '9ed02a46-8470-424b-a900-23405ff45d0c'} Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:25.447663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:38:25.448895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.450011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:25.450011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ec83f33e-df56-4e62-ac35-5ed0d84fb729 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 404 len: 111 microversion: 2.1 time: 0.033789 Sep 01 05:38:25.450011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 308/628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:25 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:25.455738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-540faf02-fbce-4b57-ae4e-b96408f79764 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '.version_select at 0x7fbb6ba46790>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.528674 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-540faf02-fbce-4b57-ae4e-b96408f79764 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-30138198" status: 202 len: 0 microversion: 2.1 time: 0.076661 Sep 01 05:38:25.529343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 321/629] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Sep 1 05:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-30138198 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:38:26.353834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9f997910-4fd1-4332-aebc-9126ad0bcf73 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: .version_select at 0x7fbb6b8c9c10>, body: {"keypair": {"name": "tempest-keypair-2037195648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOzcjJKuQV6ITw0kDKhxy/0WJ2xgMEuSqqw3CYqkGmv7D/bq4AcYp4NY32+3e94Y88s++CHvhrRxxqDUwqgzDBnebShS3erFirk9Gb+OG95Fq+2cvxFfAHmG4ltKDfzA=="}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:26.371669 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-9f997910-4fd1-4332-aebc-9126ad0bcf73 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for project 337817b568b64e98bc2bfd177e984351. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:26.376514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-9f997910-4fd1-4332-aebc-9126ad0bcf73 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for user e9ad5076ef93462fbe614d7fc323935d and project 337817b568b64e98bc2bfd177e984351. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:26.499125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9f997910-4fd1-4332-aebc-9126ad0bcf73 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152878 Sep 01 05:38:26.499748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 309/630] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:38:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:28.956697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-213739770", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a16813a5-5346-45d6-922a-cc80e1d12942"}], "security_groups": [{"name": "tempest-securitygroup--587341092"}], "key_name": "tempest-keypair-2037195648", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:29.080995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] validate_networks() for [('a16813a5-5346-45d6-922a-cc80e1d12942', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:38:29.516147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:38:29.516708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:38:29.517178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:38:29.517609 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:38:29.518072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:38:29.527234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.527712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.528142 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.528866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.529315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.529840 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.548493 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for project 337817b568b64e98bc2bfd177e984351. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:29.553098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Getting quotas for user e9ad5076ef93462fbe614d7fc323935d and project 337817b568b64e98bc2bfd177e984351. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:29.569429 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:38:29.572936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:38:29.697854 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-24f0bace-54bc-417b-a9a4-e2583e5de969 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.745350 Sep 01 05:38:29.698766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 322/631] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:38:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:38:29.710411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-825538a4-5214-4785-a4e1-d554eddc5451 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:29.711793 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-825538a4-5214-4785-a4e1-d554eddc5451 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:29.824238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-825538a4-5214-4785-a4e1-d554eddc5451 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:29.831909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-825538a4-5214-4785-a4e1-d554eddc5451 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1237 microversion: 2.1 time: 0.125514 Sep 01 05:38:29.842390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 310/632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:29 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1237 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:30.324507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2d015268-dbce-4ec4-97ba-34d1fbee6e54 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: .version_select at 0x7fbb6bd91f70>, body: {"keypair": {"name": "tempest-keypair-808351638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7WBQPsXGXqLB/KenEL6vDHXyaAUZ2K2ebJPuXGDQKl/bj+voyaHCMe9mAjAuOtYwqEUB5R2bmTD3RJwwtCkib5/gQ/k/4NWJihAITP+mPJMVQpmZaulkceHelGdVpcOg=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:30.346588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-2d015268-dbce-4ec4-97ba-34d1fbee6e54 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:30.354382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-2d015268-dbce-4ec4-97ba-34d1fbee6e54 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for user 1aa49a620d0e42b0947215d200fa45a1 and project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:30.479184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2d015268-dbce-4ec4-97ba-34d1fbee6e54 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.297432 Sep 01 05:38:30.479790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 323/633] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 1 05:38:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 299 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 05:38:30.857373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:30.858030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:30.864735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.865215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.865664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.866379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.866825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.867926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.936380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:30.943370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-252b29d2-6405-44c4-a126-2a6af067a7eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1241 microversion: 2.1 time: 0.090069 Sep 01 05:38:30.943951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 311/634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:30 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:31.965499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:31.966134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:31.968229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:31.973405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.974194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.974783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.975647 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.976310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.977043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.084018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:32.112999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5be0078e-a7e9-41ed-a5c2-4a502b59ef5b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1297 microversion: 2.1 time: 0.144647 Sep 01 05:38:32.112999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 324/635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:31 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:33.091385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-494827918", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "937e7802-e783-49e4-9d4e-903ea5f711c0"}], "security_groups": [{"name": "tempest-securitygroup--1423994404"}], "key_name": "tempest-keypair-808351638", "user_data": "}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:33.128050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:33.131165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:33.140299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.141014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.141553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.143149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.143760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.144328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.279172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] validate_networks() for [('937e7802-e783-49e4-9d4e-903ea5f711c0', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:38:33.452672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:33.461653 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c6272728-24b9-4c8b-8103-f3f04163470a tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.336924 Sep 01 05:38:33.463357 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 325/636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:33 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:34.066183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:38:34.067082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:38:34.067880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:38:34.068513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:38:34.068927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:38:34.078649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.079125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.079553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.080275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.080719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.081355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.099183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:34.104911 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for user 1aa49a620d0e42b0947215d200fa45a1 and project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:34.137393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:38:34.139809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:38:34.263216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1b0b68f3-ef30-4417-88f5-fb0fc868a155 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.177231 Sep 01 05:38:34.264038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 312/637] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 1 05:38:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:38:34.278397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:34.279060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:34.305613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c069799c-9105-459f-a4bf-2d6d3de457bd", "tag": "8b54e56a-0d5b-4b30-b20e-15faac9c45ce"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:34.319311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.320079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.320803 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.340842 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] Creating event network-changed:8b54e56a-0d5b-4b30-b20e-15faac9c45ce for instance c069799c-9105-459f-a4bf-2d6d3de457bd on hv-cinder-85220 Sep 01 05:38:34.353685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-99b80d54-fdc9-40c5-8e9d-c980793fd67f req-3051a9bd-d9af-476e-be65-19d21a382d02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054605 Sep 01 05:38:34.354642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 313/638] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:34.383083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.396287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.397835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.399432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0ae88867-cfc4-4edf-af86-b5db6c54b218 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1280 microversion: 2.20 time: 0.128285 Sep 01 05:38:34.399713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 326/639] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:34 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:34.484103 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:34.484908 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:34.491282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.491758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.492805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.493522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.493970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.494385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.968366 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.977270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cfaca5d4-cce2-432b-9812-06cd2c42f70b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.496838 Sep 01 05:38:34.978054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 314/640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:34 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:35.421894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:35.422494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:35.429250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.430398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.431102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.431791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.432232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.432642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.508995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.517267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.518664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.519768 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-50fb5089-1e13-4833-a9c1-5a3aa8a70d38 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1284 microversion: 2.20 time: 0.101916 Sep 01 05:38:35.520315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 327/641] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:35 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:35.998759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:35.999385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:36.005822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.006300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.006723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.007400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.007854 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.008454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.142021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.150231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a5c40e89-82f0-43d8-8e12-97bf4b14d3b6 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.155289 Sep 01 05:38:36.150798 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 315/642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:35 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:36.546580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:36.547119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:36.553603 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.554074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.555232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.556200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.556641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.557053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.620662 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.628681 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.630125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.631199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-74c87cb4-e51d-468a-921e-e8823f8abb06 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1276 microversion: 2.20 time: 0.088651 Sep 01 05:38:36.631738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 328/643] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:36 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:37.170060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.170743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.177029 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.177523 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.177944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.178608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.179047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.179460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.305391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.313060 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b247be57-d436-4e9d-8ae2-82f775a5bc5e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.146782 Sep 01 05:38:37.313638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 316/644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:37.653714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.654304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.660508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.660989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.661428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.662364 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.662976 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.663399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.728883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.737068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.738511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.739591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eade540a-8e27-43c9-a69c-acf36ee30904 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1276 microversion: 2.20 time: 0.089819 Sep 01 05:38:37.740136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 329/645] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:38.334097 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.334651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.341723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.342310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.342734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.343412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.343853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.344264 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.567614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.576268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-26e68192-0a7b-4ef7-8226-d191585d134c tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.246139 Sep 01 05:38:38.576896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 317/646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.763574 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.768532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.770594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.771072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.771497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.772179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.772618 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.773034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.840355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.848588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.849984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.854690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4850261d-5b95-4610-a301-dc2d7ff38c8b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1338 microversion: 2.20 time: 0.091385 Sep 01 05:38:38.854690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 330/647] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:39.596498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:39.597144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:39.604895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.605529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.605992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.606757 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.607202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.607615 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.735376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c069799c-9105-459f-a4bf-2d6d3de457bd", "name": "network-vif-plugged", "status": "completed", "tag": "8b54e56a-0d5b-4b30-b20e-15faac9c45ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:39.741588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:39.746509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.746977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.747399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.758929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] Creating event network-vif-plugged:8b54e56a-0d5b-4b30-b20e-15faac9c45ce for instance c069799c-9105-459f-a4bf-2d6d3de457bd on hv-cinder-85220 Sep 01 05:38:39.764520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-6789ebcf-b50e-4515-b9ed-5f045c8725fb req-fc372adb-441b-46da-8852-5c740a7ff854 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033398 Sep 01 05:38:39.765243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 331/648] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:39.837862 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:39.850996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-db8d7ff2-6ffb-471c-9cb4-1927d3f73920 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.258304 Sep 01 05:38:39.852722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 318/649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:39 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:39.874964 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:39.875756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:39.883070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.883900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.884398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.885364 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.885907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.886401 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.017631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.026936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.028658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.033810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b2e9fe5-cbce-41d9-a761-26f87ec430d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.159400 Sep 01 05:38:40.033810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 332/650] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:39 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:40.349216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:40.358664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.359142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.359572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.370466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] Creating event network-changed:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:38:40.375382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-7a27fb78-de21-40b0-bda8-39602383e17a req-c661fe8a-6c31-4590-be1d-d46abb392b4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029842 Sep 01 05:38:40.375967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 319/651] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:40.872684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:40.873269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:40.879799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.880362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.880795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.881566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.881990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.882403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.014782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.017045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:41.023048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-60e83740-9d4c-447f-a99c-09102936d349 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.154229 Sep 01 05:38:41.023602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 333/652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:40 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:41.053815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:41.055157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:41.061318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.061826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.062258 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.062988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.063433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.063843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.194738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.203174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.204595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.205708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-15aed45a-ba59-4cf0-9ec3-9dd99d9173d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.156571 Sep 01 05:38:41.206261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 320/653] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:41 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:42.044217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:42.044819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:42.051815 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.052320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.052751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.053442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.053905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.054881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.229122 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:42.238721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:42.238721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.238721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.238721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.239139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.239139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.239139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.296803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.305232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-89211573-231e-4592-8cf9-a72174aae1f3 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1362 microversion: 2.1 time: 0.264803 Sep 01 05:38:42.317520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 334/654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:42 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:42.467583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.475626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.477838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.479015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8271291a-53d5-4d3c-b11b-6acd781774f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.254435 Sep 01 05:38:42.479575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 321/655] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:42 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:43.327474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.328005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.334424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.334894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.335315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.336569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.337191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.337631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.467411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.475102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ad445f85-9df6-486c-9f0d-bd4ed0cb0250 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1548 microversion: 2.1 time: 0.151554 Sep 01 05:38:43.475655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 335/656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:43.496133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.496622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.502234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.502925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.503107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.503587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.504035 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.504719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.505162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.505609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.509415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.509922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.510344 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.511022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.511459 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.511867 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.612364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7856cea7-49e1-4769-9e36-81e0ae70fd34 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120647 Sep 01 05:38:43.612958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 322/657] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:43.767801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.769573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.770973 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.772114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7c8ca925-4f3b-4e04-a432-129af05a0f81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.273666 Sep 01 05:38:43.772657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 336/658] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:38:44.792609 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:44.793391 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=12 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:44.797927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:44.798567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:44.804811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.805409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.805875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.806574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.807019 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.807441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.904799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c069799c-9105-459f-a4bf-2d6d3de457bd", "tag": "8b54e56a-0d5b-4b30-b20e-15faac9c45ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:44.913991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=12 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:44.916037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.916512 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.916935 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.930271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] Creating event network-changed:8b54e56a-0d5b-4b30-b20e-15faac9c45ce for instance c069799c-9105-459f-a4bf-2d6d3de457bd on hv-cinder-85220 Sep 01 05:38:44.935610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-22828e3c-f484-4567-bced-3a407a587c60 req-bb921ef6-ec4a-4b6c-a385-d94c67c1abcc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034759 Sep 01 05:38:44.936352 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 337/659] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:44.970257 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:44.979363 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:44.980821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:44.981982 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-24ea8639-050f-4d9a-9894-d32b1283b9e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.190329 Sep 01 05:38:44.982726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 323/660] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:44 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:46.005360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:46.006079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:46.013259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:46.013779 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:46.014206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:46.014889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:46.015326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:46.015734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:46.152890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:46.160830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:46.162281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:46.163358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7386311d-8abd-467b-980b-c0819e7b02b9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.162867 Sep 01 05:38:46.163921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 338/661] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:45 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:47.186719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:47.187358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:47.194548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.195041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.195470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.196168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.196614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.197028 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.199987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:47.330747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:47.339591 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:47.341008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:47.342117 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4475790a-c0ef-4fc9-b693-a7ea6cd582a8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.159339 Sep 01 05:38:47.342743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 324/662] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:47 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:47.711792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "name": "network-vif-plugged", "status": "completed", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:47.722318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.722793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.723231 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.734262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] Creating event network-vif-plugged:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:38:47.739048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-95153e85-d215-400d-a2ed-0e4553eb2b0d req-ed4d3787-1f34-4bdd-9359-f524b49668d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 Sep 01 05:38:47.744803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 339/663] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:48.364569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:48.365170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:48.372291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:48.372796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:48.373196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.373996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:48.374416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:48.374829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.505661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:48.514340 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:48.515767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:48.516857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-10b76627-319a-419e-bcef-21bc72922189 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.156281 Sep 01 05:38:48.517409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 325/664] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:48 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:49.541403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:49.542104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:49.548171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.548644 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.549059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.549755 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.550191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.550598 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.680791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:49.689062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:49.690794 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:49.691898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-adc512a1-d5e8-4536-b072-031d4c00bb9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1406 microversion: 2.20 time: 0.156103 Sep 01 05:38:49.692452 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 340/665] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:49 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:38:50.714246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:50.714849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:50.721369 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.721880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.722308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.722992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.723433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.723847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.858403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:50.869641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:50.877066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:50.877066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-734620a6-c777-4bac-9e8d-dfca31bcb598 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1598 microversion: 2.20 time: 0.162810 Sep 01 05:38:50.877066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 326/666] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:38:50 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:38:50.898226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:50.899019 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:50.905468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.905967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.906391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.907081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.907532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.907949 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.986617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4cb87f43-41eb-45fe-ae9c-42a02c236592 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095477 Sep 01 05:38:50.987206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 341/667] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 1 05:38:50 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:38:51.991452 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:52.001641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:52.002203 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:52.002630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:52.014593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] Creating event network-changed:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:38:52.019816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-226b5bed-89de-4e2e-bd36-03cb5fdd8200 req-5265d379-94f0-4d07-b43c-c49020df8512 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032802 Sep 01 05:38:52.020410 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 327/668] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:11.596479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=37 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:11.597241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=39 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:11.601307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:11.601824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:11.608203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:11.625397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:11.625397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:11.625397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:11.625397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:11.625891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:11.634690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-568d4046-723b-46a0-922b-54b4c557cab7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/ips" status: 200 len: 149 microversion: 2.1 time: 0.039971 Sep 01 05:39:11.635253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 342/669] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:39:11 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:39:14.274005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:14.274842 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=19 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:14.279155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af42b3a4-0f3c-486d-bb16-a7378694539d"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:14.281553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:14.287564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:14.287980 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:14.288408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:14.289086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:14.289554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:14.289973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:14.971168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-adaf95e9-14b7-4402-8a3b-f38bf36253bd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698550 Sep 01 05:39:14.971771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 328/670] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:39:14 2022] POST /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:22.489254 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af42b3a4-0f3c-486d-bb16-a7378694539d"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:22.491589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:22.500626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.501135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.501594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.502282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.502748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.503161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.585395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments HTTP/1.1 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 74 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:39:22.587134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {"volumeAttachment": {"volumeId": "af42b3a4-0f3c-486d-bb16-a7378694539d"}} Sep 01 05:39:22.588522 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'server_id': '7d6b8455-d438-4f74-add3-da00e0b64d03', 'body': {'volumeAttachment': {'volumeId': 'af42b3a4-0f3c-486d-bb16-a7378694539d'}}} Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:22.589448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:22.591032 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 400 to user: Invalid volume: volume af42b3a4-0f3c-486d-bb16-a7378694539d is already attached to instances: 7d6b8455-d438-4f74-add3-da00e0b64d03 {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-09fad070-7a79-406a-8e21-a93312e4ddeb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103798 Sep 01 05:39:22.593098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 343/671] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:39:22 2022] POST /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:39:22.654874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:22.656630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:22.661712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.662220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.662699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.663389 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.663833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.664248 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.745907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'services' on Instance uuid 7d6b8455-d438-4f74-add3-da00e0b64d03 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:39:22.978962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-61610aff-565d-4db8-ae9b-46ac209c7fa7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments/af42b3a4-0f3c-486d-bb16-a7378694539d" status: 202 len: 0 microversion: 2.1 time: 0.328703 Sep 01 05:39:22.979563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 329/672] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:39:22 2022] DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments/af42b3a4-0f3c-486d-bb16-a7378694539d => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:39:22.988591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:22.990849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:22.997856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:23.001578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:23.001578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:23.001578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:23.001578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:23.001976 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:23.032259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c7c489a6-1064-439a-a583-40f736ca53c5 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Sep 01 05:39:23.032806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 344/673] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:22 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:24.047381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:24.049799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:24.055891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:24.056368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:24.056791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:24.057491 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:24.057934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:24.058344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:24.088108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c7ec5871-ec90-460c-a939-d1859b4627e9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Sep 01 05:39:24.088656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 330/674] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:24 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:25.100736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:25.102995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:25.109400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.109905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.110329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.111004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.111444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.111857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.139873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-355180f6-6d0d-4dc7-bfe4-c8fdeee2b728 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043214 Sep 01 05:39:25.141054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 345/675] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:25 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:39:25.201068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:25.201593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:25.208415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.208881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.209301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.210006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.210472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.210879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.235880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:39:25.459618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-07df4d31-2622-457f-88f5-cdb46844262d tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 204 len: 0 microversion: 2.1 time: 0.261890 Sep 01 05:39:25.460120 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 331/676] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:39:25 2022] DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:39:25.468071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:25.472157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:25.475608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.476083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.476535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.477211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.477693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.478108 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.606022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:25.614568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb9963b4-27f7-496f-b255-452c56326840 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1679 microversion: 2.1 time: 0.150260 Sep 01 05:39:25.615128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 346/677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:25 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:26.636172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:26.636862 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:26.643802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:26.644273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:26.644696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:26.645364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:26.645843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:26.646254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:26.775906 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:26.784145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-390d29f8-f843-48a8-ae9f-790921231e5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1679 microversion: 2.1 time: 0.152161 Sep 01 05:39:26.784705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 332/678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:26 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:27.805955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:27.806582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:27.813399 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:27.813866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:27.814289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:27.814969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:27.815404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:27.816061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:28.243919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:28.252605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bd4b3fd9-6b56-4807-a941-0606640ea524 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1679 microversion: 2.1 time: 0.450431 Sep 01 05:39:28.253169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 347/679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:27 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1679 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:28.621613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6b8455-d438-4f74-add3-da00e0b64d03", "name": "network-vif-deleted", "tag": "df3b7a4c-a21a-45a1-926e-48de5643353c"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:28.630998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:28.631597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:28.632025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:28.643676 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] Creating event network-vif-deleted:df3b7a4c-a21a-45a1-926e-48de5643353c for instance 7d6b8455-d438-4f74-add3-da00e0b64d03 on hv-cinder-85220 Sep 01 05:39:28.649151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-0be6dc55-a131-4823-969e-aed7f3f91e6a req-b9ea46d9-77cb-4be8-ab1e-d804a7e84a83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Sep 01 05:39:28.649791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 333/680] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:29.274386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:29.275020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:29.281776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:29.282278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:29.282711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:29.283413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:29.283862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:29.284287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:29.317409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:29.317926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:29.318355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:29.318883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'fault' on Instance uuid 7d6b8455-d438-4f74-add3-da00e0b64d03 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:39:29.363445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:29.371330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f4405019-7f15-476e-8aaa-c821fbc3e4c0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 200 len: 1330 microversion: 2.1 time: 0.100812 Sep 01 05:39:29.371890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 348/681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:29 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:30.392813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:30.393522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:30.400127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:30.400619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:30.401027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:30.401732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:30.402170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:30.402587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:30.415580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 HTTP/1.1 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:39:30.417149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:39:30.422127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '7d6b8455-d438-4f74-add3-da00e0b64d03'} Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:30.423513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:39:30.425256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:39:30.426654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:30.426654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1c4d60d7-99ae-417d-a6cb-ba16710eb69b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 404 len: 111 microversion: 2.1 time: 0.030146 Sep 01 05:39:30.426654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 334/682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:30 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:39:30.428163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-42b62b43-a7cd-4030-97b2-8d4ccc8f5ffb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '.version_select at 0x7fbb6baecee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:30.522454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-42b62b43-a7cd-4030-97b2-8d4ccc8f5ffb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39288595" status: 202 len: 0 microversion: 2.1 time: 0.097952 Sep 01 05:39:30.523039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 349/683] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Sep 1 05:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39288595 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:39:31.265327 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4a0b926b-30a2-453c-9997-4f117071919b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: .version_select at 0x7fbb6ba43550>, body: {"keypair": {"name": "tempest-keypair-435808581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+5Yuz2OLfl46g87V71TxMT6CLIVuepkedFQ2mmXhaeh+zXa++rBU4kOvk/cz16iewoLfyQVAX8mHA8M5H8We3Bpc7C4wnQiZgQaeToDj606duOZ0fJZAuYjRDnTRWZHQ=="}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:31.280962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-4a0b926b-30a2-453c-9997-4f117071919b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:39:31.285432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-4a0b926b-30a2-453c-9997-4f117071919b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:39:31.340758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4a0b926b-30a2-453c-9997-4f117071919b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079328 Sep 01 05:39:31.341431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 335/684] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:39:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:33.382206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1980360722", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292c4ef4-bb7c-4583-ab02-5307a5a77a17"}], "security_groups": [{"name": "tempest-securitygroup--5282589"}], "key_name": "tempest-keypair-435808581", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:33.482922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] validate_networks() for [('292c4ef4-bb7c-4583-ab02-5307a5a77a17', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:39:33.856318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:39:33.856732 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:39:33.857191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:39:33.857630 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:39:33.858030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:39:33.866632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:33.867095 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:33.867513 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:33.868216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:33.868650 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:33.869057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:33.886124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:39:33.890303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Getting quotas for user b9db0f3de10842eb97dc6fc580f4489a and project d02b8bfcfa134334858ed8b7981348f1. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:39:33.901828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:39:33.904159 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:39:34.022497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-361addd3-a3d9-4262-b6ba-f11c03355d67 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.645234 Sep 01 05:39:34.023128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 350/685] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:39:33 2022] POST /compute/v2.1/servers => generated 399 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:39:34.034773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8266bead-7312-42e5-b3a4-e3e6a17bf6e0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:34.035385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8266bead-7312-42e5-b3a4-e3e6a17bf6e0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:34.094297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8266bead-7312-42e5-b3a4-e3e6a17bf6e0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:34.101875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8266bead-7312-42e5-b3a4-e3e6a17bf6e0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1241 microversion: 2.1 time: 0.071720 Sep 01 05:39:34.102437 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 336/686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:34 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:35.123999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:35.124614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:35.132169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:35.132648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:35.133070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:35.133848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:35.134290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:35.134700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:35.200240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:35.208645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e63caf3a-e940-496a-8665-b9f88fe975fa tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1237 microversion: 2.1 time: 0.088895 Sep 01 05:39:35.209184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 351/687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:35 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:36.233775 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:36.234547 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:36.243395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:36.243986 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:36.244412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:36.245978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:36.246425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:36.246840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:36.318037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:36.325672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dd86e7eb-f21f-4608-b128-d3dedd1cdfde tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1311 microversion: 2.1 time: 0.096105 Sep 01 05:39:36.329346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 337/688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:36 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:37.347212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:37.347819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:37.355236 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:37.355718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:37.356148 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:37.356871 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:37.357319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:37.357761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:37.572028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:37.579774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-02fd26ae-5262-41ed-964c-d9b566abcb0b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.236435 Sep 01 05:39:37.580341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 352/689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:37 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:37.716679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aebd542-aa56-4b0a-bef1-6759713b6d50", "tag": "159daa8a-2ea5-43f8-9924-16417fef391d"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:37.727151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:37.727910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:37.730079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:37.740852 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] Creating event network-changed:159daa8a-2ea5-43f8-9924-16417fef391d for instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 on hv-cinder-85220 Sep 01 05:39:37.745970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-c89a624d-b9e2-469f-94ba-af075314e39f req-9d5f1dc8-5694-4366-93c8-1499745bda2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032860 Sep 01 05:39:37.746557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 338/690] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:38.600329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:38.600939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:38.607409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:38.607909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:38.608332 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:38.609011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:38.609466 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:38.611457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:38.741864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:38.749417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-28d4cdae-b194-4dc8-96c4-2eb66054b8d0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.152990 Sep 01 05:39:38.749996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 353/691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:38 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:39.772245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:39.772932 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:39.779532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:39.780003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:39.780426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:39.781094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:39.781583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:39.782178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:39.913984 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:39.921602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f48fe4bb-bcfb-46ca-bfd0-ceb07628a657 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.154033 Sep 01 05:39:39.922164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 339/692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:39 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:40.943720 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:40.944323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:40.950780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:40.951254 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:40.951704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:40.952377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:40.952818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:40.953229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.079782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:41.087436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8bad7568-d5f6-4472-8d55-83fee06f97fd tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.147842 Sep 01 05:39:41.087989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 354/693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:40 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:39:42.108572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:42.109189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:42.116768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:42.117239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:42.117688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:42.118354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:42.118790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:42.119225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:42.248413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:42.255963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d490a863-d728-40e4-8b3e-afd35da070c6 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.151194 Sep 01 05:39:42.256519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 340/694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:42 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:43.277017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:43.277658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:43.284692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.285172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.285632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.286325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.286770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.287188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.415700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:43.423430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e15c7b85-8c03-467e-a318-a185b10f3ed8 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.150324 Sep 01 05:39:43.423985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 355/695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:43 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:44.444434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:44.445036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:44.447520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:44.448201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:44.452777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.453249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.454220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.454892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.455334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.455744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.459668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:44.595876 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:44.603480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-77b8c0a0-96db-4dca-895b-e7e99f4f76cb tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.163141 Sep 01 05:39:44.604048 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 341/696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:44 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:45.623974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:45.624573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:45.626944 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:45.627588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:45.633310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.633817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.634244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.634917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.635358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.635770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.764682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:45.773060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5e51ed76-4963-43e6-8a7a-9c0526177277 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.152891 Sep 01 05:39:45.773643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 356/697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:45 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:46.024904 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aebd542-aa56-4b0a-bef1-6759713b6d50", "name": "network-vif-plugged", "status": "completed", "tag": "159daa8a-2ea5-43f8-9924-16417fef391d"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:46.035307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.037428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.037428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.046875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] Creating event network-vif-plugged:159daa8a-2ea5-43f8-9924-16417fef391d for instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 on hv-cinder-85220 Sep 01 05:39:46.052936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-171f1052-299b-4a32-aba4-3b087706adcf req-70d677a3-71cf-4ec7-830d-b5e783f5fa24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Sep 01 05:39:46.053708 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 342/698] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:46.793544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:46.794149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:46.801617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.802100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.802564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.803281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.803751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.804166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.934936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:46.943565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-07830e53-8178-4bd1-8298-cb4ec435e446 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.153889 Sep 01 05:39:46.944131 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 357/699] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:46 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:47.965485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:47.966179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:47.973273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:47.974276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:47.974276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:47.975005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:47.975448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:47.975863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.106424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:48.115012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-01e4ce6c-2e64-4b75-ba40-64ba9027c917 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1364 microversion: 2.1 time: 0.154488 Sep 01 05:39:48.115578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 343/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:47 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.135830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.136435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:49.143532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.143998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.144422 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.145094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.145561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.145972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.277218 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:49.285125 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1a92f776-5e22-4f14-9ed5-e996b3d57f00 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1554 microversion: 2.1 time: 0.153109 Sep 01 05:39:49.285719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 358/701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:49 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.305187 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.305724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:49.312252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.312726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.313165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.314407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.314848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.315259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.391271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e5c5433a-b6bf-48fa-90a0-91e3ceebe638 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089992 Sep 01 05:39:49.391881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 344/702] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 1 05:39:49 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:50.372532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aebd542-aa56-4b0a-bef1-6759713b6d50", "tag": "159daa8a-2ea5-43f8-9924-16417fef391d"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:50.382810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.383380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.383870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:50.395398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] Creating event network-changed:159daa8a-2ea5-43f8-9924-16417fef391d for instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 on hv-cinder-85220 Sep 01 05:39:50.400515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0783df18-d3bb-49e2-bd05-df911ed21b97 req-3bb848a6-bdd3-4757-b235-4bcc559eddc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Sep 01 05:39:50.401162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 359/703] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:55.859276 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:55.859840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:55.866584 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.867057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.867479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.868158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.868594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.869010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.892849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3ca7a456-acf4-4584-b6a8-a6ef5d23a87e tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/ips" status: 200 len: 146 microversion: 2.1 time: 0.038085 Sep 01 05:39:55.893411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 345/704] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:39:55 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:58.520209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c827425a-8133-4348-b7f6-90943e783659"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:58.522843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:58.525226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:58.530081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.530561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.530995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.531682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.532127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.532599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.538136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=95 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:59.207062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb348e63-610a-4f0f-89b3-4d66ae3a9c68 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689806 Sep 01 05:39:59.207525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 360/705] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:39:58 2022] POST /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:06.736800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:06.739151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:06.741676 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=9 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:06.742362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=21 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:06.746968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.747445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.747871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.748592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.749030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.749443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.780525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-519fdf01-3e55-412e-af82-fb6395fada5d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Sep 01 05:40:06.781075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 346/706] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:40:06 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:06.792987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:06.793616 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:06.800279 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.804160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.804160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.804160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.804160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.804531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.833331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a344dc86-efc5-4c58-9505-a3aeb3bb9648 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659" status: 200 len: 194 microversion: 2.1 time: 0.044693 Sep 01 05:40:06.833937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 361/707] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 1 05:40:06 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:06.927895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:06.928386 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:06.934829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.935308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.935733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.936408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.936852 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.937261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.961321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-df745288-4624-4fe9-ba54-0fe772b3f5d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/ips" status: 200 len: 151 microversion: 2.20 time: 0.038059 Sep 01 05:40:06.961920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 347/708] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 1 05:40:06 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:40:08.498192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42ed9021-7db3-4f9f-9bef-4de269b48c3c"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:08.500483 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:08.506883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:08.507358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:08.509756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:08.509756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:08.509756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:08.509756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:09.343714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-440a0984-e624-480e-82f5-5d56ffa156e2 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "POST /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849144 Sep 01 05:40:09.344310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 362/709] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:40:08 2022] POST /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:10.330628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:10.331227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:10.338218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.338687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.339107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.339776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.340213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.340625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.363118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lazy-loading 'flavor' on Instance uuid 43ced258-af06-4363-8db0-0f5b110bd561 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:10.774415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7ffb002a-ac75-4e6c-accd-0f0444420e97 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/action" status: 202 len: 0 microversion: 2.20 time: 0.447615 Sep 01 05:40:10.775009 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 348/710] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 1 05:40:10 2022] POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:40:10.784908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:10.785892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:10.792542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.793021 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.793441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.794147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.794633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.795039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.928682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:10.936946 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:10.939268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:10.940463 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b985389b-d4e4-477b-8666-cebee1c5b26b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.160172 Sep 01 05:40:10.941015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 363/711] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:10 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:11.965006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:11.965789 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:11.972099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:11.972588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:11.973018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:11.974343 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:11.974791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:11.975209 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:12.110847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:12.119038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:12.120520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:12.121693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-266ba46c-b376-435a-907e-9ef711804e6f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.161507 Sep 01 05:40:12.122242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 349/712] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:11 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:13.144153 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:13.144675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:13.152229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:13.152693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:13.153110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:13.153803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:13.154241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:13.154645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:13.281966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:13.290104 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:13.291530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:13.292665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-60f5df53-ecb5-4179-9233-b746d283e503 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.152448 Sep 01 05:40:13.293222 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 364/713] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:13 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:14.315085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:14.315687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:14.323232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:14.323654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:14.324084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:14.324767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:14.325212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:14.325659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:14.457059 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:14.465727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:14.467171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:14.468324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5da3fbb0-07cc-4ac1-b421-6b5bf3ffb242 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.157160 Sep 01 05:40:14.468888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 350/714] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:14 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:15.492420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:15.493002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:15.499448 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:15.499917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:15.500337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:15.501004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:15.501439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:15.501870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:15.632712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:15.640715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:15.642158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:15.643286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c3ac3f98-26d6-4574-8abd-23f01ed6739c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.155631 Sep 01 05:40:15.643873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 365/715] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:15 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:16.667120 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:16.667744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:16.674354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:16.684112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:16.684112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:16.684112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:16.684112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:16.684525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:16.809387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:16.818518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:16.819994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:16.821148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4e89182e-884a-4f1d-8a46-cb15a433f537 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.158359 Sep 01 05:40:16.821774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 351/716] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:16 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:17.844283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:17.844886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:17.851388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.851872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.852301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.852988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.853430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.853872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.925709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:17.928026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:17.934421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.934903 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.935330 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.936017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.936464 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.936877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.967592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dee87719-608a-4ac4-a9e3-b022f4e11be5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046034 Sep 01 05:40:17.968152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 352/717] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:40:17 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:40:17.991891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:17.999849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:18.001271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:18.002435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-413821ab-e885-4c56-82ac-f4bdc5b32a47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.162041 Sep 01 05:40:18.002986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 366/718] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:17 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:18.109865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:18.110352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:18.116476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.116953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.117381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.118100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.118527 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.118940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.147896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-844cf710-7ea6-40af-be75-080a4c7d4298 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659" status: 200 len: 194 microversion: 2.1 time: 0.042084 Sep 01 05:40:18.148465 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 353/719] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 1 05:40:18 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:18.158691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:18.159183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:18.165540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.166018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.166447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.167128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.167578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.167996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.247620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lazy-loading 'services' on Instance uuid c069799c-9105-459f-a4bf-2d6d3de457bd {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:18.464918 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d4371f41-754a-46a4-8ff0-c17fe62d2f51 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659" status: 202 len: 0 microversion: 2.1 time: 0.309982 Sep 01 05:40:18.465711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 367/720] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:40:18 2022] DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/c827425a-8133-4348-b7f6-90943e783659 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:40:19.027239 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:19.027876 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:19.034341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:19.034823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:19.035259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:19.036131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:19.036568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:19.036987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:19.165322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:19.173326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:19.174786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:19.175935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5690cf0c-90df-49b7-a9f1-e1e471a1b9fc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.152665 Sep 01 05:40:19.176492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 354/721] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:19 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:20.200434 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:20.201035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:20.207230 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.208298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.208724 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.209398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.209862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.210276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.342128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:20.350942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:20.352380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:20.353563 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ec90aadc-97cc-4445-9db2-3fbb0bf871d4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.158094 Sep 01 05:40:20.354112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 368/722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:20 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:20.644947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:20.645705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:20.652033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.652509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.652937 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.653643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.654090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.654508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.684361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-04d2d6d8-4f39-4e52-b500-1caf85f27218 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/42ed9021-7db3-4f9f-9bef-4de269b48c3c" status: 200 len: 194 microversion: 2.1 time: 0.043410 Sep 01 05:40:20.684941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 355/723] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 1 05:40:20 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/42ed9021-7db3-4f9f-9bef-4de269b48c3c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:20.696750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:20.697312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:20.703584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.704058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.704487 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.705170 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:20.705649 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:20.706064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.787752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lazy-loading 'services' on Instance uuid c069799c-9105-459f-a4bf-2d6d3de457bd {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:20.972636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1c12cdaf-a96e-4f6e-a9ca-49a88c03c93b tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/42ed9021-7db3-4f9f-9bef-4de269b48c3c" status: 202 len: 0 microversion: 2.1 time: 0.281011 Sep 01 05:40:20.973908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 369/724] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:40:20 2022] DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments/42ed9021-7db3-4f9f-9bef-4de269b48c3c => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:40:21.376106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:21.376699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:21.383400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:21.383872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:21.384298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:21.384998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:21.385444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:21.385882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:21.512501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:21.521173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:21.522794 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:21.523999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-53f2a820-6e15-4bbd-abb3-bf62f60093be tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.151809 Sep 01 05:40:21.524546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 356/725] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:21 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:22.547470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:22.548154 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:22.555340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:22.555892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:22.556388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:22.557166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:22.557704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:22.558186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:22.689796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:22.699205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:22.702063 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:22.704280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-acd48ecc-e342-48a6-ac2a-6e30db4fb962 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.161155 Sep 01 05:40:22.705311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 370/726] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:22 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:23.199179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.201320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.207751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.208224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.208653 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.209341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.209811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.210229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.241495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0fbfb273-47f8-4faa-b527-1953686dd9eb tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046252 Sep 01 05:40:23.242053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 357/727] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:40:23 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:40:23.351989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.354248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.360248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.360726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.361155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.361928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.362380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.362798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.394273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9ba948c8-1cb6-4c2e-b56c-0ee33453ee6d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046776 Sep 01 05:40:23.395321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 371/728] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:40:23 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:40:23.455985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.456480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.463163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.464026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.464461 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.465126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.465601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.466012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.491660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:40:23.721953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c0167fdb-c825-498e-865e-43338c5f27d5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 204 len: 0 microversion: 2.1 time: 0.269344 Sep 01 05:40:23.722467 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 358/729] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:40:23 2022] DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:40:23.734383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.734383 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.736033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.736723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.737914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.738392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.739505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.740457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.740895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.741325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.743477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.743958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.744388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.745070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.745540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.745961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.750684 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:23.946577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:23.950812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:23.953307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:23.954231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-69e07b46-b915-4cb5-9ae4-3bd41fa7aa46 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1673 microversion: 2.1 time: 0.222431 Sep 01 05:40:23.954994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 359/730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:23 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:23.960907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:23.962367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:23.964901 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c551f629-037c-4660-bb38-f2b6c46dddc9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.237289 Sep 01 05:40:23.964901 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 372/731] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:23 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:24.975457 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:24.976043 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:24.982605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.983143 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.983511 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:24.984190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.984632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.985047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:24.986537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:24.987306 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:24.995203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.995697 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.996112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:24.996802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.997244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.997686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:25.186030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:25.190149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:25.194645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4fd1abc4-f93a-4248-8f6d-d59f98cd276d tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1673 microversion: 2.1 time: 0.222966 Sep 01 05:40:25.195219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 360/732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:24 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:25.200085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:25.201536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:25.202688 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d4adad15-f69b-4b27-a4a5-04cefe9a920e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.219987 Sep 01 05:40:25.203230 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 373/733] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:24 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:26.126704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "name": "network-vif-plugged", "status": "completed", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:26.137103 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.137601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.138019 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.149500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] Creating event network-vif-plugged:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:40:26.154309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-52143545-2d56-4097-91bd-0264e2b037e2 req-92a27c54-bc5d-4605-9545-aa7f149cedc7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031282 Sep 01 05:40:26.154884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 361/734] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:26.216439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:26.217143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:26.223981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.231360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.231360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.231360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.231360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.231754 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.231845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:26.231845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:26.235172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.235661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.236091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.236773 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.237213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.237812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.424680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:26.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:26.433385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-383aaeee-62d8-4cb5-8959-82156ebe94d4 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1673 microversion: 2.1 time: 0.220868 Sep 01 05:40:26.434004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 374/735] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:26 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:26.437298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:26.438827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:26.439976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-632e1952-f384-4018-8050-475942cac2df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.218086 Sep 01 05:40:26.440517 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 362/736] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:26 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:27.455226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:27.455807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:27.462349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:27.462826 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:27.463256 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.463608 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:27.464037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:27.464287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:27.464408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:27.464763 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.470963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:27.471519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:27.472018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.472768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:27.474102 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:27.474592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.544747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:27.553257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-919973e9-e262-499c-abbc-84c84d93ba5f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1606 microversion: 2.1 time: 0.101729 Sep 01 05:40:27.554190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 375/737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:27 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:27.651410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c069799c-9105-459f-a4bf-2d6d3de457bd", "name": "network-vif-deleted", "tag": "8b54e56a-0d5b-4b30-b20e-15faac9c45ce"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:27.670201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:27.675283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:27.675283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.679858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:27.685801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] Creating event network-vif-deleted:8b54e56a-0d5b-4b30-b20e-15faac9c45ce for instance c069799c-9105-459f-a4bf-2d6d3de457bd on hv-cinder-85220 Sep 01 05:40:27.691630 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-babc6c31-c280-49b4-a43b-73c914c13886 req-ed39ac5d-ccee-4832-9be1-89d55afc725f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045350 Sep 01 05:40:27.691936 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:27.692977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 376/738] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:27.697222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:27.698457 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7e37da44-2493-4f53-8938-4cd388be2c60 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.239017 Sep 01 05:40:27.700887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 363/739] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:27 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:28.576897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:28.577716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:28.584688 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.585164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.585629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.586317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.586787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.587202 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.618864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.619336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.619760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.620192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lazy-loading 'fault' on Instance uuid c069799c-9105-459f-a4bf-2d6d3de457bd {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:28.661392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad5076ef93462fbe614d7fc323935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337817b568b64e98bc2bfd177e984351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:28.669144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-addef429-4d5c-4618-ade0-dc5322f6dfd5 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 200 len: 1327 microversion: 2.1 time: 0.097026 Sep 01 05:40:28.669734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 377/740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:28 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:28.721926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:28.722518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:28.730638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.731247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.731739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.732660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.734036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.734463 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.876728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:28.885743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:28.887167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:28.891107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-00d4fb40-2658-418f-bb43-1cff97e8eaef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1743 microversion: 2.20 time: 0.170605 Sep 01 05:40:28.891107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 364/741] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:28 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:29.690074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:29.690676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:29.694637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=38 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:29.699497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.700214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.700821 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:29.702536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.703460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.707532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:29.731195 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd HTTP/1.1 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:40:29.732873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:29.734395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'c069799c-9105-459f-a4bf-2d6d3de457bd'} Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:29.735187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:29.736496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:29.739474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:29.739474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f1064a61-9cb0-46a1-8654-1535ef14d814 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 404 len: 111 microversion: 2.1 time: 0.048061 Sep 01 05:40:29.739474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 378/742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:29 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:29.745215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fe24eeae-21a7-43db-8156-18723710c480 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '.version_select at 0x7fbb6b995d30>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:29.822950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fe24eeae-21a7-43db-8156-18723710c480 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037195648" status: 202 len: 0 microversion: 2.1 time: 0.080911 Sep 01 05:40:29.826950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 365/743] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 1 05:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037195648 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:40:29.914794 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:29.915808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:29.927826 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.928414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.929341 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:29.934058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.934058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.934487 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:30.122939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:30.133288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:30.135544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:30.136859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fb6633e2-d0e6-4a18-a7d0-e50f481387f4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.230240 Sep 01 05:40:30.137941 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 379/744] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:29 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:31.161590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:31.162917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:31.170875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:31.171607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:31.172215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:31.173238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:31.173691 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:31.173978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:31.338797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:31.347507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:31.350478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:31.351658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b07429bb-34a8-4636-9291-c9222a1ed30b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.195346 Sep 01 05:40:31.368286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 366/745] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:31 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:32.376317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:32.377249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:32.385683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:32.386324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:32.386925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:32.387770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:32.388370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:32.388890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:32.548832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:32.557144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:32.558602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:32.559757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-59edc407-cd82-4584-8a10-83e45be578a7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.187860 Sep 01 05:40:32.560301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 380/746] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:32 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:33.298671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:33.299266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:33.307208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.307974 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.308516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.309441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.310123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.310540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.327711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd HTTP/1.1 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:40:33.329840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.331498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': 'c069799c-9105-459f-a4bf-2d6d3de457bd'} Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:33.332949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.334823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.336951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:33.336951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-68d0bfe4-b387-4621-b5cf-6b662006183f tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 404 len: 111 microversion: 2.1 time: 0.036765 Sep 01 05:40:33.336951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 367/747] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:40:33 2022] DELETE /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:33.340978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:33.341616 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: c069799c-9105-459f-a4bf-2d6d3de457bd] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:33.349297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.349728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.350138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.350825 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.351262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.351676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.366509 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd HTTP/1.1 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:40:33.368073 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.369689 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'c069799c-9105-459f-a4bf-2d6d3de457bd'} Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:33.370604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. Sep 01 05:40:33.372324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:33.373699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance c069799c-9105-459f-a4bf-2d6d3de457bd could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:33.373699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-992c5dfd-e135-43db-83f2-05734a0f0167 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd" status: 404 len: 111 microversion: 2.1 time: 0.032750 Sep 01 05:40:33.375520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 381/748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:33 2022] GET /compute/v2.1/servers/c069799c-9105-459f-a4bf-2d6d3de457bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:33.583638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:33.584243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:33.590847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.591581 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.592181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.593055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:33.593548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:33.593972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:33.744274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:33.754393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:33.757068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:33.759072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8027a36c-5caa-4bc3-a007-4c995ae449ff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.180038 Sep 01 05:40:33.759817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 368/749] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:33 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:34.667773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:34.668929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:34.675584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.676225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.677064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.677863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.678518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.678939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.693579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c HTTP/1.1 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:40:34.695103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.696615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '9ed02a46-8470-424b-a900-23405ff45d0c'} Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:34.697376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.698673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.699963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:34.699963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2a4b0476-615f-40de-90ba-3f3aaeb65f56 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 404 len: 111 microversion: 2.1 time: 0.032540 Sep 01 05:40:34.699963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 382/750] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:40:34 2022] DELETE /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:34.706062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:34.706659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] [instance: 9ed02a46-8470-424b-a900-23405ff45d0c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:34.714962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.715699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.717919 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.718809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.719420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.719988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.743477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] HTTP exception thrown: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Request method failure captured: Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c HTTP/1.1 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEOL8xTEoHBw_IYt9k_i8e-8n3z0Y_duSdO1n9t77kGUlwPttx1yF3-QGr27_dQPUQZ-E73WXir5zhNIbygICb4yiDyvnRLVrZpx_G2ENs1PuGPx8VGuAew8RTGzpQpNepU_h-aPvZ2GAWnZ1F7Cf8ICxVgJohsHlFhmnO6c_Ax0SCA Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:40:34.745049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337817b568b64e98bc2bfd177e984351", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337817b568b64e98bc2bfd177e984351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337817b568b64e98bc2bfd177e984351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 337817b568b64e98bc2bfd177e984351 Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-608218284 Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: e9ad5076ef93462fbe614d7fc323935d Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeTestJSON-608218284-project Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.746506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '9ed02a46-8470-424b-a900-23405ff45d0c'} Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:34.747266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. Sep 01 05:40:34.748685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:40:34.750709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] Returning 404 to user: Instance 9ed02a46-8470-424b-a900-23405ff45d0c could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:34.750709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c9534178-2b60-4681-9a66-28609ad03530 tempest-AttachVolumeTestJSON-608218284 tempest-AttachVolumeTestJSON-608218284-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c" status: 404 len: 111 microversion: 2.1 time: 0.044279 Sep 01 05:40:34.761975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 369/751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:34 2022] GET /compute/v2.1/servers/9ed02a46-8470-424b-a900-23405ff45d0c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:34.782786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:34.783387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:34.790684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.791420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.792045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.793082 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.793884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.794985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.982856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:34.992918 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:34.999028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:35.000268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d6d8e9f4-73e6-4d6f-8453-b763019df7f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.221475 Sep 01 05:40:35.002114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 383/752] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:34 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:36.025178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:36.025909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:36.032427 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:36.032909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:36.033328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:36.034039 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:36.034473 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:36.034879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:36.170662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:36.179927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:36.181340 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:36.182856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-960a0d4d-1404-45bb-955c-b1a0702bf1cc tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.161522 Sep 01 05:40:36.183589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 370/753] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:36 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:37.205954 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:37.206579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:37.214567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:37.221999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:37.222698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:37.224444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:37.225069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:37.225677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:37.452482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:37.463737 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:37.465173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:37.470419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0b8a03ec-2774-4100-85ab-a8432f8eb4ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.268140 Sep 01 05:40:37.485898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 384/754] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:37 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:38.496759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:38.498076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:38.502379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:38.509426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:38.515689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:38.515689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:38.515689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:38.515689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:38.516037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:38.741388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:38.762399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:38.764725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:38.766225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ad1b8bd7-2c36-4339-bc8d-d3ee42d591e2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.273149 Sep 01 05:40:38.767321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 371/755] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:38 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:39.790327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:39.790930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:39.797354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:39.797891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:39.798320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:39.798998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:39.799476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:39.799886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:39.947839 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:39.958070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:39.959965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:39.961375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-64d65b1a-a0dc-4680-a79f-a174409643d0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.174964 Sep 01 05:40:39.962078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 385/756] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:39 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:40.984743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:40.985268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:40.992674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:40.994164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:40.994164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:40.994384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:40.994719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:40.995131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:41.393095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:41.402425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:41.403841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:41.404976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-89ca7d1b-1931-400e-b944-63434e027156 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1738 microversion: 2.20 time: 0.424341 Sep 01 05:40:41.405542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 372/757] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:40 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:42.429678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:42.433960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:42.437850 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.438418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.438910 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.439790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.440168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.440588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.783132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:42.791838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:42.793298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:42.794722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6069410a-b003-4acf-9687-1435f63145da tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1720 microversion: 2.20 time: 0.370483 Sep 01 05:40:42.795389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 386/758] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:42 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:43.819082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:43.819674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:43.826038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.826510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.826935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.827599 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.828035 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.828446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.959681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:43.967740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:43.969172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:43.970422 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-138c2390-c732-43a0-a088-b3b11c3f43d1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1720 microversion: 2.20 time: 0.156307 Sep 01 05:40:43.971036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 373/759] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:43 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:44.994176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:44.994798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.001156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.001686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.002101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.002783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.003224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.003638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.139843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:45.149536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:45.151013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:45.152182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1f82012a-fcf3-4b44-b912-9b08400f24e9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1723 microversion: 2.20 time: 0.161880 Sep 01 05:40:45.152722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 387/760] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:44 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:45.174792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d58b9b20-70f2-4ce6-856c-fd1d2efcf260"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:45.177723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.184222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.189409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.189409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.189409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.189409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.189804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.083304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-517c72cb-48dd-4c44-8dca-9a8b7145274d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.912117 Sep 01 05:40:46.083929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 374/761] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 1 05:40:45 2022] POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments => generated 188 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:40:46.134786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "name": "network-vif-unplugged", "status": "completed", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:46.148809 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.149441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.150076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.168819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.compute.server_external_events [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] Unable to find a host for instance 43ced258-af06-4363-8db0-0f5b110bd561. Dropping event network-vif-unplugged {{(pid=121031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:40:46.169911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c539e683-726d-4842-b07d-c9bc734dd0cb req-466b7f5f-13ef-46d8-a6b0-2010fe062da8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040194 Sep 01 05:40:46.170684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 388/762] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 05:40:46.235964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:46.235964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:46.239681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.240285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.240809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.241612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.242130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.242637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.293277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121033) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:40:46.380388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:46.540353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-107eae8f-19d0-4d51-a9f8-3af6da310f9e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/action" status: 202 len: 0 microversion: 2.20 time: 0.312569 Sep 01 05:40:46.541099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 375/763] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 1 05:40:46 2022] POST /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:40:46.556359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:46.556359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:46.557656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.558162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.558641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.559333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.559800 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.560223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.699553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:46.708998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:46.711081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:46.711777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e865329c-e8ff-4967-8c44-d167d4488492 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1749 microversion: 2.20 time: 0.166413 Sep 01 05:40:46.716465 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 389/764] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:46 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:47.734312 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:47.734845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:47.742081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.742548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.742969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.743635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.744069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.744474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.875099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.884289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.885735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.886874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-39b72a6b-41cf-4482-b779-39ea05f5a74d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1749 microversion: 2.20 time: 0.156629 Sep 01 05:40:47.887418 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 376/765] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:47 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:48.909542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:48.910135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:48.917713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.918186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.918606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.919281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.919718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.920128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.051363 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.061053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.062502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.063703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0aeda4cd-11ed-48f1-9783-69f83efb26b3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1749 microversion: 2.20 time: 0.158015 Sep 01 05:40:49.064459 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 390/766] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:48 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:50.088447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:50.089531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:50.095786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.096258 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.096686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.097361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.097835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.098249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.228293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.237809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.239224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.240613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-67b48c91-27c4-409a-88ad-24c9bf5367ee tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1749 microversion: 2.20 time: 0.157749 Sep 01 05:40:50.241091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 377/767] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:50 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:51.263849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:51.264387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:51.270710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.271187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.272129 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.272803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.273248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.273700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.406347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.415585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.417062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.418232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a6c85e44-2c05-401a-bb02-84aaccc478f9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1749 microversion: 2.20 time: 0.158430 Sep 01 05:40:51.418766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 391/768] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:51 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:52.441621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:52.442252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:52.449995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.450555 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.450995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.451692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.452217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.452716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.589327 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:52.599016 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:52.600598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:52.601906 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7ad1f52e-e97a-49e3-abe9-dbdec9af5c5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1751 microversion: 2.20 time: 0.164098 Sep 01 05:40:52.602498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 378/769] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:52 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:53.629745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:53.629745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:53.635673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:53.636158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:53.636581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:53.637270 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:53.637738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:53.638162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:53.653375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:53.771319 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:53.781054 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:53.782817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:53.784084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d8899eb4-9a7b-4b2a-8702-e3b9d1e282d8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1751 microversion: 2.20 time: 0.160644 Sep 01 05:40:53.784636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 392/770] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:53 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:40:54.808183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:54.808883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:54.815500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.815978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.816404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.817129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.817646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.818282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.078409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.089089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.090629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.091923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2c0dbb58-b848-4564-b6f0-2abb2f9914a2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.287644 Sep 01 05:40:55.092537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 379/771] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:54 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:56.118877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:56.119998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:56.127830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.128498 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.135196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:56.135196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.135196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.135196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:56.311053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:56.320233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:56.321732 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:56.326818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-58a8c551-be81-412d-9619-1a29f48eb07c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.210381 Sep 01 05:40:56.326818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 393/772] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:56 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:57.347630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:57.348286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:57.356084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:57.357062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:57.357730 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.358750 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:57.359348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:57.360000 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.569602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:57.583008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:57.584624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:57.585813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dc6b9237-0777-4d3f-9377-ce09e047563c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.242621 Sep 01 05:40:57.586884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 380/773] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:57 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:58.609842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:58.611160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:58.618829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.619606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.620132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.621087 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.621790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.622420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.784639 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:58.795375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:58.796943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:58.798369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e49b79a-ce95-41fd-8b08-dfa9591c202a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.192223 Sep 01 05:40:58.799018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 394/774] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:58 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:40:59.823272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:59.823858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:59.832229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.833080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.833974 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.835261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.836062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.836793 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.978970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.989281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.991297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.992523 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-64ad4b12-c146-4d29-9fce-142b58bb8e16 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.173391 Sep 01 05:40:59.993093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 381/775] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:40:59 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:01.032429 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:01.033092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:01.035524 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=34 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:01.041274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.041274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.041274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.042074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.042518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.042930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.188029 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:01.199312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:01.200975 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:01.202307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6c60d5d0-c158-4314-bf28-94dfbe69d08e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.173831 Sep 01 05:41:01.202963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 395/776] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:01 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:02.225659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:02.227054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:02.235077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.235840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.236275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.236979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.237426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.237871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.397176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:02.406950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:02.408286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:02.409577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e992a8bf-4865-4258-9c1b-58af02146f3b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.188239 Sep 01 05:41:02.410132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 382/777] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:02 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:03.435353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:03.436038 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:03.442436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.443919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.444536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.445786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.446468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.447062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.596808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.606786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.608569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.610019 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7f75949d-01a9-482c-b43f-7eacc25004c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.179766 Sep 01 05:41:03.610791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 396/778] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:03 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:04.633831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:04.634405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:04.642211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.643176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.643623 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.644365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.644829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.645252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.827139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.841844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.843654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.845230 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dc094697-97fa-4825-b214-854b36d29435 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.215621 Sep 01 05:41:04.846318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 383/779] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:04 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:05.379220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:05.379870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:05.387037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.387511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.387930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.388608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.389045 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.389501 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.419245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6d3e1ce6-1824-42b0-b1e2-f713ae2da87b tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/ips" status: 200 len: 150 microversion: 2.1 time: 0.043854 Sep 01 05:41:05.420562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 397/780] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:41:05 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:05.876191 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:05.876908 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:05.883858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.884329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.884753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.885449 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.885951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.886356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:06.043419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:06.054417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:06.056441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:06.058634 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a42c0daf-819e-4279-a2d8-2f95c7595d9c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.186207 Sep 01 05:41:06.059466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 384/781] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:05 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:07.083318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:07.084636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:07.091120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:07.091599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:07.092033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.092714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:07.093163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:07.093619 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.241956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.250722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.252193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.253333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aaf09e25-a2f2-47ee-bd15-98c805dcd25f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.174140 Sep 01 05:41:07.253921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 398/782] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:07 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:08.110284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3965e4d7-916a-4f91-a4d0-415b529a36d3"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:08.112852 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:08.120577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.121038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.121561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.122369 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.122814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.123243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.276384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:08.277072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:08.283494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.283998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.284395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.285139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.285610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.286028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.421585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:08.431100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:08.432525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:08.433765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7cd9f856-4591-4a52-ba60-b4797c7f8ee5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.161387 Sep 01 05:41:08.434441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 399/783] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:08 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:09.458495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:09.458495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:09.465731 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.466282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.466704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.467396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.467835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.468249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.608692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.625559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.625559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.625559 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9a203957-b072-4dd7-b65a-d3acdbe1cd49 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.167525 Sep 01 05:41:09.626117 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 400/784] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:09 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:10.589728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-93700e4e-14f8-4525-9d77-3514c812a984 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "POST /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.483531 Sep 01 05:41:10.595448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 385/785] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:41:08 2022] POST /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments => generated 194 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:10.647070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:10.659020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:10.667109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.667109 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.667577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.668305 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.668750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.669166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.807460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.817029 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.819022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.822041 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-02e7feb4-75cf-4047-9224-8f5f29955ed0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.178468 Sep 01 05:41:10.822041 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 401/786] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:10 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:11.845279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:11.846037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:11.847957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:11.853673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.854152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.854580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.859428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.859428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.859428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.000490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.010549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.012001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.013154 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-faa78292-1fcf-476d-b133-7690bcbd819d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.172688 Sep 01 05:41:12.013724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 386/787] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:11 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:13.036033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:13.036640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:13.042957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.043437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.043864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.044546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.044987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.045405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.181550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:13.190791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:13.192250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:13.193699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2e5c7b6c-55fe-4842-8443-aa95e5572bdd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.161145 Sep 01 05:41:13.194249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 402/788] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:13 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:14.216774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:14.217372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:14.223961 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.224432 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.224872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.225557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.225995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.226403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.365804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.375405 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.376808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.377989 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8e81c6bd-a19e-4b4a-b6d3-d9eb667e7385 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.165137 Sep 01 05:41:14.378541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 387/789] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:14 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:15.402848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:15.403479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:15.410083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.410550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.410971 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.411647 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.412084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.412491 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.547264 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:15.557103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:15.558603 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:15.559777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9f78343b-d479-4fc6-a90c-d598394ee37d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.161728 Sep 01 05:41:15.560330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 403/790] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:15 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:16.583058 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:16.583642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:16.590856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.591325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.591737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.592443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.592882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.593296 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.726755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.735216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.736648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.737838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0c82257b-42de-4363-ac05-4efdbd834cfb tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.158736 Sep 01 05:41:16.738395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 388/791] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:16 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:17.765447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:17.765447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:17.772721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.773197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.773656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:17.775103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.775550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.775973 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:17.913773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:17.924188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:17.926070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:17.927387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a17ecbca-aed6-428a-a55c-6a51618852c8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.165937 Sep 01 05:41:17.928009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 404/792] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:17 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:18.953114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:18.953762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:18.959901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.960372 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.960797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.961604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.962046 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.962450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.966707 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:19.107895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:19.116553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:19.118570 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:19.120026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-36f52f16-73b0-4042-8b48-fdd76e02bfe3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.171227 Sep 01 05:41:19.120730 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 389/793] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:18 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:19.302850 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:19.303393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:19.310813 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.311284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.311739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.312484 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.312874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.313288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.394631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lazy-loading 'services' on Instance uuid 3aebd542-aa56-4b0a-bef1-6759713b6d50 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:41:19.612997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dad9daac-e947-4e90-9bc9-3ceb0c2e812c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments/3965e4d7-916a-4f91-a4d0-415b529a36d3" status: 202 len: 0 microversion: 2.1 time: 0.313936 Sep 01 05:41:19.613609 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 405/794] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:41:19 2022] DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments/3965e4d7-916a-4f91-a4d0-415b529a36d3 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:41:19.622141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:19.624348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:19.630727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.631214 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.631643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.632332 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.632783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.633236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.664238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7de16011-3325-4d2c-b692-4c5cd54bba5a tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Sep 01 05:41:19.665896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 390/795] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:41:19 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:20.144500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:20.145183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:20.152638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.153113 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.153567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.154329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.154793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.155209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.297588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:20.306900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:20.308371 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:20.309569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-53756c9a-c906-4daa-9694-9e5e7c95043b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.169318 Sep 01 05:41:20.310110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 406/796] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:20 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:20.364433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "name": "network-vif-plugged", "status": "completed", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:20.373188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.373826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.374244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.386031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] Creating event network-vif-plugged:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:41:20.390829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-dbf7f25e-aa93-49a5-addf-cdb98857782b req-eec83a16-5cae-4a9b-9519-91b74d1088f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Sep 01 05:41:20.391426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 391/797] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:20.676798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:20.679182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:20.686119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.686572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.686993 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.687657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.688094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.688500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.722197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-23f82e9d-9d97-499e-af50-e9eb056c8c06 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Sep 01 05:41:20.722751 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 407/798] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:41:20 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:21.333619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:21.334110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:21.340594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.341076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.341597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.342293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.342752 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.343165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.477376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:21.486541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:21.488002 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:21.489159 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d335014b-b702-480e-814d-e3425fb63db2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.160117 Sep 01 05:41:21.489752 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 392/799] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:21 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:21.734515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:21.736788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:21.743476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.743948 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.744374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.745057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.745527 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.745942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.770807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:21.776983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-81055714-92b1-4f66-b0c0-7733a4af0eb7 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046416 Sep 01 05:41:21.777563 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 408/800] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:41:21 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:41:21.841922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:21.842400 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:21.848393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.848871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.849294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.850014 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:21.850456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:21.850867 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.878015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:41:22.145388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-22cd751e-6d90-4690-abea-19e29aa26199 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 204 len: 0 microversion: 2.1 time: 0.306908 Sep 01 05:41:22.146002 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 393/801] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:21 2022] DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:41:22.155134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:22.155827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:22.162632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.163112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.163536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.164246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.164938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.165552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.300299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:22.309406 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eaf89f59-07de-4a70-9048-7f4ecb05e9c4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1679 microversion: 2.1 time: 0.158433 Sep 01 05:41:22.310007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 409/802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:22 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:22.514669 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:22.515552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:22.521768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.522243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.522666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.523342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.523957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.524693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.658198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:22.667086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:22.668798 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:22.670249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4ec3962e-ad5f-4d90-a086-807f92041a81 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.160134 Sep 01 05:41:22.671103 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 394/803] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:22 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:23.331863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:23.332531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:23.340945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.341423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.341877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.342562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.343001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.343410 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.474848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:23.483216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ae4c53cc-2604-4ced-a5b9-45699afb5b59 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1679 microversion: 2.1 time: 0.155100 Sep 01 05:41:23.483776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 410/804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:23 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:23.694135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:23.695448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:23.701966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.702446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.702873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.703566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.704011 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.704429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.847664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:23.857360 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:23.858846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:23.860024 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1680af29-a22b-45b6-823d-12d7cab221ef tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.170103 Sep 01 05:41:23.861488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 395/805] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:23 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:24.504670 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:24.505302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:24.512441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.512917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.513407 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:24.514101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.514547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.514963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:24.737090 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:24.745529 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-daaecbbe-38a3-4fdb-b0fa-ddbf86296ade tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1679 microversion: 2.1 time: 0.244598 Sep 01 05:41:24.746103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 411/806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:24 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:24.882815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:24.883376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:24.890271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.890762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.891201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:24.891950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.892403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.892823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.132426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:25.142092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:25.143446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:25.144586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e0cc34b7-50b1-41f3-9762-aaa6f817959c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1807 microversion: 2.20 time: 0.265913 Sep 01 05:41:25.145144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 396/807] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:24 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:41:25.580209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aebd542-aa56-4b0a-bef1-6759713b6d50", "name": "network-vif-deleted", "tag": "159daa8a-2ea5-43f8-9924-16417fef391d"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:25.590943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:25.591482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:25.591813 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.603328 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] Creating event network-vif-deleted:159daa8a-2ea5-43f8-9924-16417fef391d for instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 on hv-cinder-85220 Sep 01 05:41:25.608418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-ec9f49d6-1aac-4406-a510-d6b41b429194 req-c42c75a9-715e-4495-b053-a7e87af7803c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Sep 01 05:41:25.615805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 412/808] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:25.768810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:25.769866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:25.778221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:25.779028 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:25.779534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.780388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:25.780839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:25.781253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.853720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9db0f3de10842eb97dc6fc580f4489a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02b8bfcfa134334858ed8b7981348f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:25.861723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6a37aefd-eea1-4295-82b0-70671ad0d3b0 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 200 len: 1326 microversion: 2.1 time: 0.097851 Sep 01 05:41:25.863499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 397/809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:25 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:26.170607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:26.171298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:26.177766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.178244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.178668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.179354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.179796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.180207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.312434 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:26.321821 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:26.323241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:26.324433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6a8ddbd4-dd11-4922-9ba0-c91193b984e3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1794 microversion: 2.20 time: 0.160013 Sep 01 05:41:26.324983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 413/810] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:41:26 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:41:26.884032 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:26.885228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:26.891728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.892198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.892621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.893289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.893755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.894165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.907863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 HTTP/1.1 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:26.909475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:26.911091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '3aebd542-aa56-4b0a-bef1-6759713b6d50'} Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:26.911895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:26.913440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:26.914851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:26.914851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3c46a179-2155-48f2-bbbd-754bb47133f1 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 404 len: 111 microversion: 2.1 time: 0.032690 Sep 01 05:41:26.914851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 398/811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:26 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:26.921923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ca91c2a-e3c4-4115-baa3-597bd6c1371c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '.version_select at 0x7fbb6b918040>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:27.015065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8ca91c2a-e3c4-4115-baa3-597bd6c1371c tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435808581" status: 202 len: 0 microversion: 2.1 time: 0.096889 Sep 01 05:41:27.015629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 414/812] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 1 05:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435808581 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:41:28.967260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:28.967768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:28.974129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:28.974597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:28.981792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:28.981792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:28.981792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:28.981792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:28.990316 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 HTTP/1.1 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:28.991866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:28.993503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '3aebd542-aa56-4b0a-bef1-6759713b6d50'} Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:28.994451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:28.996090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:28.997616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:28.997616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f102a41-dbf3-4d8a-b328-97cfd4913084 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 404 len: 111 microversion: 2.1 time: 0.030656 Sep 01 05:41:28.997616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 399/813] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:28 2022] DELETE /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:29.002480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:29.003075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 3aebd542-aa56-4b0a-bef1-6759713b6d50] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:29.009582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:29.010977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:29.011273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:29.011939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:29.012368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:29.012773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:29.028832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 HTTP/1.1 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:29.030475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:29.032043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '3aebd542-aa56-4b0a-bef1-6759713b6d50'} Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:29.032938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. Sep 01 05:41:29.034435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:29.035810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 3aebd542-aa56-4b0a-bef1-6759713b6d50 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:29.035810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4c842926-500f-497b-9560-1e18b8a52f5e tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50" status: 404 len: 111 microversion: 2.1 time: 0.033671 Sep 01 05:41:29.035810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 415/814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:28 2022] GET /compute/v2.1/servers/3aebd542-aa56-4b0a-bef1-6759713b6d50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:30.317206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:30.317748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:30.325930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.326404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.326845 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.327510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.327952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.328364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.342529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 HTTP/1.1 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:30.344063 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.345704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '7d6b8455-d438-4f74-add3-da00e0b64d03'} Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:30.346541 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.347997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.349502 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:30.349502 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-026be22a-7bfa-42b9-9ed0-d784f6a0ffe9 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 404 len: 111 microversion: 2.1 time: 0.031969 Sep 01 05:41:30.349502 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 400/815] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:30 2022] DELETE /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:30.353647 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:30.354602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 7d6b8455-d438-4f74-add3-da00e0b64d03] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:30.362219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.362696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.363120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.363803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.364236 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.364643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.378945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 HTTP/1.1 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:30.380492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.382349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '7d6b8455-d438-4f74-add3-da00e0b64d03'} Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:30.383119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. Sep 01 05:41:30.384566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.386596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 7d6b8455-d438-4f74-add3-da00e0b64d03 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:30.386596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ed67319f-3e9a-4547-b36c-2dc4e81b73be tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03" status: 404 len: 111 microversion: 2.1 time: 0.032152 Sep 01 05:41:30.386596 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 416/816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:30 2022] GET /compute/v2.1/servers/7d6b8455-d438-4f74-add3-da00e0b64d03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:30.391667 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:30.392265 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:30.403065 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.403745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.403965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.408485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.408945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.409362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.427576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c HTTP/1.1 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:30.429082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.433706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '5d790d97-9608-4cc6-a1a6-52511c16036c'} Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:30.434612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.436072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.437606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:30.437606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8fed4d99-5c3a-4f25-b41f-b958a35bbe57 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 404 len: 111 microversion: 2.1 time: 0.042747 Sep 01 05:41:30.437606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 401/817] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:30 2022] DELETE /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:30.439991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:30.440605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 5d790d97-9608-4cc6-a1a6-52511c16036c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:30.447108 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.447778 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.448371 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.449061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.449528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.449950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.463553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c HTTP/1.1 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:30.465051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.467431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '5d790d97-9608-4cc6-a1a6-52511c16036c'} Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:30.468304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. Sep 01 05:41:30.469798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:30.471146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 5d790d97-9608-4cc6-a1a6-52511c16036c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:30.471146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5980441b-f6e8-417a-af60-67c659743fb4 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c" status: 404 len: 111 microversion: 2.1 time: 0.030410 Sep 01 05:41:30.471146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 417/818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:30 2022] GET /compute/v2.1/servers/5d790d97-9608-4cc6-a1a6-52511c16036c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:31.734075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:31.734572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:31.740935 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.741413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.741876 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.742557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.743005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.743424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.756739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 HTTP/1.1 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:31.758280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.760478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '2bedbeaf-c165-4774-b947-dd14b08dcb67'} Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:31.761399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.762800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.764205 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:31.764205 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-096711d0-52b6-46e9-8ba5-72e299567fbf tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 404 len: 111 microversion: 2.1 time: 0.029368 Sep 01 05:41:31.764205 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 402/819] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:31 2022] DELETE /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:31.768517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:31.769116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] [instance: 2bedbeaf-c165-4774-b947-dd14b08dcb67] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:31.771643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:31.776888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.777409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.777862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.778537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.778977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.779386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.792996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] HTTP exception thrown: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Request method failure captured: Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 HTTP/1.1 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEONLXzl0XcI9qEdKJL-pKLdzJs3bjD378WeQmphHkxhJ3QXLvqqLdMi5k96-Xw_HXzbKLkzjDOrFWolcD_lhwx42BfNSD4UWa_mfQnWX1CUeY66D8HqN0tq12mE_M2h52eW4KMCeh_dJz0S4LejMWuFIWSkTNUEGjb-Dags4OlUpiw Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:31.796994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d02b8bfcfa134334858ed8b7981348f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d02b8bfcfa134334858ed8b7981348f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: d02b8bfcfa134334858ed8b7981348f1 Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487818424 Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b9db0f3de10842eb97dc6fc580f4489a Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1487818424-project Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.798792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '2bedbeaf-c165-4774-b947-dd14b08dcb67'} Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:31.799698 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. Sep 01 05:41:31.801349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:31.803229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] Returning 404 to user: Instance 2bedbeaf-c165-4774-b947-dd14b08dcb67 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:31.803229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-754816ac-8224-40dc-a3b6-b8fd0b27efb2 tempest-AttachVolumeNegativeTest-1487818424 tempest-AttachVolumeNegativeTest-1487818424-project] 10.222.0.42 "GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67" status: 404 len: 111 microversion: 2.1 time: 0.031220 Sep 01 05:41:31.803229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 418/820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:31 2022] GET /compute/v2.1/servers/2bedbeaf-c165-4774-b947-dd14b08dcb67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:37.265008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-89e31fd3-a58a-4c52-9535-de33616d9520 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Action: 'create', calling method: .version_select at 0x7fbb6b81f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1561861652"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:37.808892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-89e31fd3-a58a-4c52-9535-de33616d9520 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.664084 Sep 01 05:41:37.809568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 403/821] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Sep 1 05:41:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 665 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:41:37.822389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9f8ba3d6-29d7-4c8f-9c76-285b559fbad6 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b885ee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:37.870632 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9f8ba3d6-29d7-4c8f-9c76-285b559fbad6 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 200 len: 345 microversion: 2.1 time: 0.052548 Sep 01 05:41:37.871194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 419/822] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:41:37 2022] GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:38.884501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-563796cc-7d93-4787-b284-c56b6e9a2f67 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b86baf0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:38.932313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-563796cc-7d93-4787-b284-c56b6e9a2f67 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 200 len: 346 microversion: 2.1 time: 0.051441 Sep 01 05:41:38.932878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 404/823] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:41:38 2022] GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:38.945768 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c094676e-b792-4685-a601-428ef208d573 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Action: 'create', calling method: .version_select at 0x7fbb6b9933a0>, body: {"snapshot": {"volume_id": "0cb56669-221b-4bbb-aca9-a9481608dc99", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-577980293"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:39.377564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c094676e-b792-4685-a601-428ef208d573 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.436228 Sep 01 05:41:39.383972 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 420/824] 10.222.0.42 () {60 vars in 1162 bytes} [Thu Sep 1 05:41:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:39.390367 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-56494e27-de1e-4186-b2bf-7f852faebbd9 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b9c45e0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:39.424168 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-56494e27-de1e-4186-b2bf-7f852faebbd9 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.039055 Sep 01 05:41:39.424771 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 405/825] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:39 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:41:39.436057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2af8b775-06c0-4aa3-bcd7-1917b21e7fd6 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6ba46a60>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:39.469710 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2af8b775-06c0-4aa3-bcd7-1917b21e7fd6 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038173 Sep 01 05:41:39.470397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 421/826] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 1 05:41:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:39.482813 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a86e741a-f38a-4fc3-9947-f7ca9446faa0 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b84a700>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:39.512532 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a86e741a-f38a-4fc3-9947-f7ca9446faa0 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.034091 Sep 01 05:41:39.513096 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 406/827] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:39 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:40.524677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cabea651-cb2e-4709-a005-298d4b7878b5 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b85baf0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:40.554807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cabea651-cb2e-4709-a005-298d4b7878b5 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.034379 Sep 01 05:41:40.555360 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 422/828] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:40 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:41.567800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-0ce424f0-0519-4fa9-a2b2-de9f7e06037d tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b81f8b0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:41.597983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-0ce424f0-0519-4fa9-a2b2-de9f7e06037d tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.034438 Sep 01 05:41:41.598572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 407/829] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:41 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:41:42.607144 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=35 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:42.611170 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c8640cf-883c-448c-b293-797075e767b4 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b918dc0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:42.643447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c8640cf-883c-448c-b293-797075e767b4 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.037346 Sep 01 05:41:42.643995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 423/830] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:42 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:43.653077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:43.653866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:43.658184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9a0e9605-88e5-44af-84b8-915c00b002fe tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b864c10>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:43.687855 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9a0e9605-88e5-44af-84b8-915c00b002fe tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.035543 Sep 01 05:41:43.688419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 408/831] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:43 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:44.700802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34a38b2a-608c-4f79-827e-fe9530727274 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b85bf70>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:44.731084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-34a38b2a-608c-4f79-827e-fe9530727274 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 287 microversion: 2.1 time: 0.034569 Sep 01 05:41:44.731641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 424/832] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:44 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:44.743095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cbec7db6-e09b-4d8b-a452-5b49fefde2ca tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b81f8b0>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:44.894588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cbec7db6-e09b-4d8b-a452-5b49fefde2ca tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 202 len: 0 microversion: 2.1 time: 0.155944 Sep 01 05:41:44.895163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 409/833] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 1 05:41:44 2022] DELETE /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:41:44.904726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3aa80fb6-5458-491a-9f8a-fb6bf1dbd47c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b993430>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:44.935555 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3aa80fb6-5458-491a-9f8a-fb6bf1dbd47c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 200 len: 286 microversion: 2.1 time: 0.035912 Sep 01 05:41:44.936113 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 425/834] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:44 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:41:45.949110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8397d46d-10b8-41cf-86a0-bb42946526b8 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b84a700>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:45.974457 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-8397d46d-10b8-41cf-86a0-bb42946526b8 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] HTTP exception thrown: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8397d46d-10b8-41cf-86a0-bb42946526b8 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Request method failure captured: Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 HTTP/1.1 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEYRVPoMhqo_YmBs9gnhAaO-lxo9Lt0YF6nxvPKx-OZJBuo-2T04sPMUqAnVZafudCLW20knJgk3lXQBeFgKuow0czTwULtYakw8n3WrZNM2Bv32_ZIJVaNxUYzZADzXZ1CkqyludoQFqmrPJV_EtoRo8KWM6AXPOb5tRqplw3hUtFU Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:45.977663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8aaba82265b84828ac8acbd02a5a0941", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b7f21cfedbd94762824620e3570d2d02 Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '18866b59-d70c-4f99-b71c-19ac92942402'} Sep 01 05:41:45.979351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. (HTTP 404) (Request-ID: req-e4c22a6e-8891-4c96-9859-db727a67913c) Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.980918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:45.982334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 05:41:45.983923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8397d46d-10b8-41cf-86a0-bb42946526b8 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Returning 404 to user: Snapshot 18866b59-d70c-4f99-b71c-19ac92942402 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:45.985388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8397d46d-10b8-41cf-86a0-bb42946526b8 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402" status: 404 len: 111 microversion: 2.1 time: 0.035776 Sep 01 05:41:45.986409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 410/835] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 1 05:41:45 2022] GET /compute/v2.1/os-snapshots/18866b59-d70c-4f99-b71c-19ac92942402 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:45.988965 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-977671d1-b939-4944-b265-444bdfce2a27 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b8f7f70>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:46.208377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-977671d1-b939-4944-b265-444bdfce2a27 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 202 len: 0 microversion: 2.1 time: 0.223557 Sep 01 05:41:46.209027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 426/836] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:41:45 2022] DELETE /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:41:46.222717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-340aad73-8c56-4d9f-8e14-75bab8f977d1 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6bb69c10>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:46.271325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-340aad73-8c56-4d9f-8e14-75bab8f977d1 tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 200 len: 345 microversion: 2.1 time: 0.052467 Sep 01 05:41:46.271325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 411/837] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:41:46 2022] GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:47.285179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4aa7471-e1c1-4870-a24f-f722c587548c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b993160>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-c4aa7471-e1c1-4870-a24f-f722c587548c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] HTTP exception thrown: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4aa7471-e1c1-4870-a24f-f722c587548c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Request method failure captured: Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 HTTP/1.1 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEYRVPoMhqo_YmBs9gnhAaO-lxo9Lt0YF6nxvPKx-OZJBuo-2T04sPMUqAnVZafudCLW20knJgk3lXQBeFgKuow0czTwULtYakw8n3WrZNM2Bv32_ZIJVaNxUYzZADzXZ1CkqyludoQFqmrPJV_EtoRo8KWM6AXPOb5tRqplw3hUtFU Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:47.317428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8aaba82265b84828ac8acbd02a5a0941", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b7f21cfedbd94762824620e3570d2d02 Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '0cb56669-221b-4bbb-aca9-a9481608dc99'} Sep 01 05:41:47.319567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. (HTTP 404) (Request-ID: req-80b64d1e-ed98-4c51-ac97-3a16da36ccf7) Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.320475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:47.321865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:41:47.323266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4aa7471-e1c1-4870-a24f-f722c587548c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Returning 404 to user: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c4aa7471-e1c1-4870-a24f-f722c587548c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 404 len: 109 microversion: 2.1 time: 0.035531 Sep 01 05:41:47.325252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 427/838] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:41:47 2022] GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:47.331996 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-da3f1829-384a-45f5-9b66-23463af1564c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b80ea60>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:47.358909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-da3f1829-384a-45f5-9b66-23463af1564c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] HTTP exception thrown: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-da3f1829-384a-45f5-9b66-23463af1564c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Request method failure captured: Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 HTTP/1.1 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEYRVPoMhqo_YmBs9gnhAaO-lxo9Lt0YF6nxvPKx-OZJBuo-2T04sPMUqAnVZafudCLW20knJgk3lXQBeFgKuow0czTwULtYakw8n3WrZNM2Bv32_ZIJVaNxUYzZADzXZ1CkqyludoQFqmrPJV_EtoRo8KWM6AXPOb5tRqplw3hUtFU Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:41:47.361218 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8aaba82265b84828ac8acbd02a5a0941", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: b7f21cfedbd94762824620e3570d2d02 Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '0cb56669-221b-4bbb-aca9-a9481608dc99'} Sep 01 05:41:47.362832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. (HTTP 404) (Request-ID: req-1741a037-14a6-469f-897f-e1b6df2b8cc1) Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.363859 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:41:47.365304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:41:47.366728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-da3f1829-384a-45f5-9b66-23463af1564c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Returning 404 to user: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-da3f1829-384a-45f5-9b66-23463af1564c tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 404 len: 109 microversion: 2.1 time: 0.035079 Sep 01 05:41:47.368129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 412/839] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 1 05:41:47 2022] DELETE /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:41:47.371497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-541d29a4-3330-48a3-bdf1-3ace3189b8cf tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Calling method '.version_select at 0x7fbb6b8570d0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:47.399994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-541d29a4-3330-48a3-bdf1-3ace3189b8cf tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] HTTP exception thrown: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-541d29a4-3330-48a3-bdf1-3ace3189b8cf tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Request method failure captured: Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 HTTP/1.1 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEYRVPoMhqo_YmBs9gnhAaO-lxo9Lt0YF6nxvPKx-OZJBuo-2T04sPMUqAnVZafudCLW20knJgk3lXQBeFgKuow0czTwULtYakw8n3WrZNM2Bv32_ZIJVaNxUYzZADzXZ1CkqyludoQFqmrPJV_EtoRo8KWM6AXPOb5tRqplw3hUtFU Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:41:47.401967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8aaba82265b84828ac8acbd02a5a0941", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8aaba82265b84828ac8acbd02a5a0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 8aaba82265b84828ac8acbd02a5a0941 Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1079247136 Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: b7f21cfedbd94762824620e3570d2d02 Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1079247136-project Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '0cb56669-221b-4bbb-aca9-a9481608dc99'} Sep 01 05:41:47.403582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. (HTTP 404) (Request-ID: req-8dcaa40e-d1eb-426b-bde0-8aea622c40bf) Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.404657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:41:47.406091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:41:47.407411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-541d29a4-3330-48a3-bdf1-3ace3189b8cf tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] Returning 404 to user: Volume 0cb56669-221b-4bbb-aca9-a9481608dc99 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-541d29a4-3330-48a3-bdf1-3ace3189b8cf tempest-VolumesSnapshotsTestJSON-1079247136 tempest-VolumesSnapshotsTestJSON-1079247136-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99" status: 404 len: 109 microversion: 2.1 time: 0.036236 Sep 01 05:41:47.408866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 428/840] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 1 05:41:47 2022] GET /compute/v2.1/os-volumes/0cb56669-221b-4bbb-aca9-a9481608dc99 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:42:42.908269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:42.914812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:42.916943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:42.917529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:42.918023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:42.918781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:42.919290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:42.919849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:42.957274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9c9bfbbc-b1b8-4b99-a6b0-51d1fe85d33c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments/d58b9b20-70f2-4ce6-856c-fd1d2efcf260" status: 200 len: 194 microversion: 2.20 time: 0.054566 Sep 01 05:42:42.959981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 413/841] 10.222.0.42 () {60 vars in 1454 bytes} [Thu Sep 1 05:42:42 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments/d58b9b20-70f2-4ce6-856c-fd1d2efcf260 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:42:43.027315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:43.031985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:43.032476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:43.041182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.041695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.042323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:43.042797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.043375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.043792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:43.130244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lazy-loading 'services' on Instance uuid 43ced258-af06-4363-8db0-0f5b110bd561 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:42:43.368962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cc6cfca7-709a-48af-ad35-3625122b8c65 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments/d58b9b20-70f2-4ce6-856c-fd1d2efcf260" status: 202 len: 0 microversion: 2.20 time: 0.342866 Sep 01 05:42:43.369599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 429/842] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 1 05:42:43 2022] DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments/d58b9b20-70f2-4ce6-856c-fd1d2efcf260 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:42:43.389542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:43.389542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:43.389993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.390475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.391053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:43.391887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.392470 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.393021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:43.609084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d1265bca-ba44-4107-bfa0-f7dbeb005f20 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.234268 Sep 01 05:42:43.609866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 414/843] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 1 05:42:43 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:42:44.622853 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:44.625111 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:44.632652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:44.633135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:44.633614 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:44.634298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:44.634767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:44.635180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:44.664998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9d7fde0d-16ee-4b34-928e-2dab55c4d13d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046610 Sep 01 05:42:44.665897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 430/844] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 1 05:42:44 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:42:45.678027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:45.686344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:45.688587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.689318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.689984 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.691475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.692836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.693517 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.728083 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7b2839a1-bd0c-45a2-a6a2-6360cb278d29 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054491 Sep 01 05:42:45.735268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 415/845] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 1 05:42:45 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:45.809582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:45.810580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:45.819860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.820707 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.821243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.822789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.823381 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.824006 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.857748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:42:46.140587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c65d2a8-d411-4bdd-9fe2-20c88dc2ab68 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 204 len: 0 microversion: 2.20 time: 0.336004 Sep 01 05:42:46.142013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 431/846] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 1 05:42:45 2022] DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:42:46.151188 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:46.151792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:46.157856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.158556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.159201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.161004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.161475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.162880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.399357 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:46.417835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:46.420490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:46.422202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fa3cf4d4-8db3-49d3-80f9-9afae730e8e4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.274487 Sep 01 05:42:46.423184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 416/847] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:46 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:42:47.447651 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:47.449152 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:47.457447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:47.458956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:47.463857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:47.464727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:47.465363 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:47.466072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:47.869005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:47.887941 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:47.889758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:47.891175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-075f275b-2cff-41d6-b8ca-afa81c5bb2a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.449087 Sep 01 05:42:47.892385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 432/848] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:47 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:42:48.924847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:48.930228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:48.952490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:48.955069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:48.962840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:48.962840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:48.962840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:48.964497 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:49.396108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:49.404576 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:49.416484 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:49.421951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9829bf1b-1960-43fd-a54d-455a30b4d2ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1722 microversion: 2.20 time: 0.506059 Sep 01 05:42:49.422525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 417/849] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:48 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:42:50.444280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:50.445149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:50.459302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:50.459788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:50.460216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:50.462967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:50.463558 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:50.464193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:50.585740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:50.605385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:50.609830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:50.611513 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-058e3a69-8148-462c-90ba-2dfd3ada2528 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1654 microversion: 2.20 time: 0.171227 Sep 01 05:42:50.615216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 433/850] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:50 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:42:50.915765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ced258-af06-4363-8db0-0f5b110bd561", "name": "network-vif-deleted", "tag": "fa99df00-4836-450e-a356-2085259399bf"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:50.931018 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:50.934281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:50.934718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:50.954384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] Creating event network-vif-deleted:fa99df00-4836-450e-a356-2085259399bf for instance 43ced258-af06-4363-8db0-0f5b110bd561 on hv-cinder-85220 Sep 01 05:42:50.961611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-68b7b767-963a-4ff0-a045-792976950e9a req-b02e748f-e55a-4b61-8841-f93a19b0b744 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.514715 Sep 01 05:42:50.962560 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 418/851] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:51.643232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:51.648717 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:51.666719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:51.667951 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:51.674146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:51.674146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:51.674146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:51.674146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:51.763325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:51.764075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:51.764701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:51.765394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lazy-loading 'fault' on Instance uuid 43ced258-af06-4363-8db0-0f5b110bd561 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:42:51.952838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:51.970739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:51.970739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:51.972925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ea72a732-080f-4e0b-aea8-4d54b3742b82 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 200 len: 1370 microversion: 2.20 time: 0.337523 Sep 01 05:42:51.979827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 434/852] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:51 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:42:52.998815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:53.001229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:53.021486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:53.021726 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:53.022380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:53.023530 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:53.028219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:53.032438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:53.063575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 HTTP/1.1 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:42:53.067812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:42:53.073149 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '43ced258-af06-4363-8db0-0f5b110bd561'} Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:42:53.074023 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:42:53.075947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:42:53.077242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:42:53.077242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-01f4502e-1532-4133-bd83-a64c66df4fb2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 404 len: 111 microversion: 2.20 time: 0.076545 Sep 01 05:42:53.077242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 419/853] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:42:52 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:42:53.081617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1a836713-8f67-4aa7-816e-48fcea8b41ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '.version_select at 0x7fbb6b8853a0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:53.186760 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1a836713-8f67-4aa7-816e-48fcea8b41ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808351638" status: 204 len: 0 microversion: 2.20 time: 0.110197 Sep 01 05:42:53.187886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 435/854] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Sep 1 05:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808351638 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:42:54.701255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: .version_select at 0x7fbb6b80e820>, body: {"keypair": {"name": "tempest-keypair-1379937833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfHmuBuJ8Blerz4E1ey1uhYp4wS9MLfhHwgW9nIrgMiSRf9fiDiHcY+47ZX2lbC0f1xfQoOXlHjm5mDbNFmvhWPXmJVforlaL3t2Oibh6elWsb5y0sfJRq9y7kOvoOmSg=="}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:54.770116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:42:54.778507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for user 1aa49a620d0e42b0947215d200fa45a1 and project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'key_pairs'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:42:54.814368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [39b0ad5a-55f7-48f8-8d6f-c8e6b78efbf6] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:42:55.824325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [39b0ad5a-55f7-48f8-8d6f-c8e6b78efbf6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 47946. Sep 01 05:42:55.934967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d4ee01ac-ec22-4f12-aa7b-4e746431ee47 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.243017 Sep 01 05:42:55.935840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 420/855] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 1 05:42:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1245 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:42:57.920502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-084cb9fc-ce13-49af-8d5b-967e58a267e3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Action: 'create', calling method: .version_select at 0x7fbb6b8f7670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1165489474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWEv/WaqIbPPgJOMq1PLsghYqovvFvM2N04HPrOqiCfy0s5+SDMLUdGJCGMlb92wbHi/3JjcIWAq/YwkbAJ6gGH4oRYsMo5D7XwMT1zZiYI6dNIKdFD8j2RU0QMEMZvqQ=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:57.939241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-084cb9fc-ce13-49af-8d5b-967e58a267e3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Getting quotas for project 138f37da900443bea3ab358845a7c773. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:42:57.944667 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-084cb9fc-ce13-49af-8d5b-967e58a267e3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Getting quotas for user 45e1b0901d174b10b49709d74d5fe5d6 and project 138f37da900443bea3ab358845a7c773. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:42:58.020576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-084cb9fc-ce13-49af-8d5b-967e58a267e3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.370283 Sep 01 05:42:58.021168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 436/856] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:42:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:00.227592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-916138483", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "937e7802-e783-49e4-9d4e-903ea5f711c0"}], "security_groups": [{"name": "tempest-securitygroup--1132233569"}], "key_name": "tempest-keypair-1379937833", "user_data": "}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:00.434624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] validate_networks() for [('937e7802-e783-49e4-9d4e-903ea5f711c0', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:43:01.280187 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:43:01.281395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:43:01.282061 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:43:01.282618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:43:01.283178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:43:01.294557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:01.295318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:01.295942 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:01.296812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:01.297419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:01.298067 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:01.329148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:01.335387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Getting quotas for user 1aa49a620d0e42b0947215d200fa45a1 and project 459dd5f92ff94f8b81d1e7213e8e7170. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:01.349626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:43:01.353071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:43:01.471545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [eab5f780-4325-469c-bfaa-c118454ff0b3] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:43:02.482417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [eab5f780-4325-469c-bfaa-c118454ff0b3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48032. Sep 01 05:43:02.494318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1b4eccf3-06a8-4f0a-b775-d1eed6aa7b1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.277761 Sep 01 05:43:02.495772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 421/857] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 1 05:43:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:43:02.508676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:02.509229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:02.511856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:02.602748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:02.625403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:02.625610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:02.626809 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6049ffa0-5c55-439d-be36-eb42bb1f2ba8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1281 microversion: 2.20 time: 0.122702 Sep 01 05:43:02.627617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 437/858] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:02 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:03.651762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:03.652373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:03.754525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:03.764017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:03.769711 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:03.771551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-842767f4-ddcf-4e7b-8b26-273c4bf0ff6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1281 microversion: 2.20 time: 0.124741 Sep 01 05:43:03.786568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 422/859] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:03 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:04.796353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:04.797838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:04.814693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.815458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.816058 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.816936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.817468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.817961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.900924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:04.912911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:04.915106 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:04.916446 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f14fcd2a-de55-4efd-9d29-a2433afe224b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1277 microversion: 2.20 time: 0.124246 Sep 01 05:43:04.917039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 438/860] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:04 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:05.940742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:05.941531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:05.977520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:05.978565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:05.979174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:05.981766 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:05.982490 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:05.983112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:06.104382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:06.116629 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:06.118112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:06.119263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-798e1c52-5aeb-4c03-a3c7-838f90eaa487 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1351 microversion: 2.20 time: 0.182934 Sep 01 05:43:06.129599 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 423/861] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:05 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:07.153786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:07.153786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:07.164691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:07.169984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:07.170811 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:07.174973 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:07.175771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:07.177685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:07.496433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:07.511389 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:07.513329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:07.516621 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0b1cce8e-976e-4f90-a181-9b69a13aeec9 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.367813 Sep 01 05:43:07.517977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 439/862] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:07 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:08.546268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:08.547908 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:08.561595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:08.567536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:08.570780 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:08.571993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:08.572641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:08.573431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:08.892820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:08.908430 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:08.912296 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:08.913746 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-016b098c-0cdd-40e3-b0af-35915ccd734a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.373806 Sep 01 05:43:08.915110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 424/863] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:08 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:09.043551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:09.062861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:09.066176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:09.066864 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:09.093891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] Creating event network-changed:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:43:09.099924 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-2366ac71-18e9-457d-9e2a-5461907ba0a8 req-d3538a0f-9a30-4342-b8ce-71bf8dc43d86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059825 Sep 01 05:43:09.101194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 440/864] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:43:09.940132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:09.940934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:09.949325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:09.952132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:09.952596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:09.953321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:09.956953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:09.957350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:10.200186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:10.212444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:10.214283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:10.215586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-07a3b67e-f6e2-4d1e-bed2-605f0657a55d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.279405 Sep 01 05:43:10.234489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 425/865] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:09 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:11.242784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:11.243385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:11.250650 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:11.251166 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:11.251665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:11.252369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:11.254553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:11.255146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:11.397414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:11.421047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:11.421047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:11.421047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d00ca9b5-9e81-4ba2-80e2-e49365224db5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.174074 Sep 01 05:43:11.421415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 441/866] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:11 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:12.434433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:12.435040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:12.438103 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:12.443923 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:12.451073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:12.451073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:12.451073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:12.451073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:12.451495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:12.595510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:12.604888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:12.609639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:12.611395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-709ca38d-229a-4e19-9114-4f3f678182d2 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.180858 Sep 01 05:43:12.625514 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 426/867] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:12 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:13.636475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:13.638952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:13.642422 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:13.643080 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:13.647600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:13.648179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:13.648617 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:13.649309 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:13.649802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:13.654245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:13.827303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:13.837400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:13.838890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:13.839980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-be61166a-95b7-4330-8e3a-4ab5735d87b0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.207479 Sep 01 05:43:13.840558 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 442/868] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:13 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:14.866957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:14.868160 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:14.870519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=12 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:14.871208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:14.876636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:14.877129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:14.881895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:14.881895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:14.881895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:14.881895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:14.882297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=61 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:15.024872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:15.034554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:15.036025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:15.037150 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-df31c378-b97a-4930-871c-03c5d4a208db tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.174068 Sep 01 05:43:15.037731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 427/869] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:14 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:15.581658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e160053-9c21-4de0-a4ad-0d1c568b50f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'create', calling method: .version_select at 0x7fbb6b8840d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-248227819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS81P4cHt6Iss4fSyK6EuZhfMAL6Jsg1qoRlTGtpPQSViiO+d2Jglyxue8lFe/pr+2fqvr5+Njd+mAnN1zBkG4Pdr+VO5k7THVWNECiMo6qaIJc7YUhHkBbxb5Jkg3ulw=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:15.598184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-0e160053-9c21-4de0-a4ad-0d1c568b50f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Getting quotas for project 1f39d8d2806b485984009aab93cb6f9d. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:15.602011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-0e160053-9c21-4de0-a4ad-0d1c568b50f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Getting quotas for user 196e0d38ea1d4669a3185cef7edef14a and project 1f39d8d2806b485984009aab93cb6f9d. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:15.671601 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0e160053-9c21-4de0-a4ad-0d1c568b50f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.093710 Sep 01 05:43:15.672134 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 443/870] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:43:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:43:15.723864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-52966471", "imageRef": "84b5efcb-b95f-47f2-a73f-5237ad58e2a7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-248227819", "networks": [{"uuid": "c05a4e86-c393-4e66-866f-348691b28754"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:15.774030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] validate_networks() for [('c05a4e86-c393-4e66-866f-348691b28754', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:43:16.059273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:16.059984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:16.066223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:16.066769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:16.071059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:16.071059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:16.071059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:16.071059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:16.201294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:43:16.201795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:43:16.202217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:43:16.202624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:43:16.203032 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:43:16.213735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:16.214219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:16.214652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:16.215376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:16.215827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:16.216249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:16.233062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Getting quotas for project 1f39d8d2806b485984009aab93cb6f9d. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:16.236988 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Getting quotas for user 196e0d38ea1d4669a3185cef7edef14a and project 1f39d8d2806b485984009aab93cb6f9d. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:16.237845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.245848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.247267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.248182 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:43:16.248351 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dfbb9ef9-e2d7-4520-baf7-5e61b821817c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.192995 Sep 01 05:43:16.248901 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 444/871] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:16 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:43:16.250330 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='84b5efcb-b95f-47f2-a73f-5237ad58e2a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:43:16.379689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e6fdb514-d615-4622-b6eb-be6339d1e6e4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660350 Sep 01 05:43:16.380331 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 428/872] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:43:16.390950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b99425f8-0a3f-434a-bed6-28f5ab3dc58e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:16.391633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b99425f8-0a3f-434a-bed6-28f5ab3dc58e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:16.447226 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b99425f8-0a3f-434a-bed6-28f5ab3dc58e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.454070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b99425f8-0a3f-434a-bed6-28f5ab3dc58e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1256 microversion: 2.1 time: 0.067084 Sep 01 05:43:16.454623 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 445/873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:16 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:17.274305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:17.275144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:17.284455 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.284974 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.285396 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.292836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.292836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.292836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.417772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.426027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.427408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.428515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9a4b6244-520f-4bcf-87bc-af85a785ade7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.160977 Sep 01 05:43:17.429077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 429/874] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:17 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:17.475154 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:17.475768 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:17.482634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.483118 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.487830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.487830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.487830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.487830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.551483 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.559980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c9bd3e5f-d718-46ef-b754-0c8412d638be tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1260 microversion: 2.1 time: 0.089255 Sep 01 05:43:17.560541 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 446/875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:17 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1260 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:18.452775 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:18.453380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:18.460774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.461259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.461722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.462420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.462870 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.463285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.581508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:18.582216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:18.589107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.589801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.590305 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.591066 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.591727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.592346 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.602415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.611290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.613184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.614373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-af890564-2b61-4e57-9a69-3f23014fef4f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.166431 Sep 01 05:43:18.614933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 430/876] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:18 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:18.692471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.701836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9d104962-112f-4721-965c-20f0dd793251 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1316 microversion: 2.1 time: 0.124980 Sep 01 05:43:18.702412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 447/877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:18 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1316 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:19.638798 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.640826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.652312 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.653477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.654836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.656226 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.657865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.659892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.726012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.726612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.740069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.741192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.741887 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.743211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.743917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.744780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:20.022296 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:20.030967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a03b0e35-1578-4d27-9a21-41972cf1879e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.309209 Sep 01 05:43:20.031660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 448/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:19 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:20.256096 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:20.271434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:20.276438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:20.278513 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d27df016-5ede-4df8-894f-b8781bf02b52 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.643399 Sep 01 05:43:20.279406 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 431/879] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:19 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:20.290585 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "name": "network-vif-plugged", "status": "completed", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:20.302470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:20.302937 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:20.304092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:20.317302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] Creating event network-vif-plugged:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:43:20.323290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-5c642a2c-c4a5-47d8-8ae8-0a4c5f069318 req-3a0e8217-b935-4589-9f84-bb2ddfcea06a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154665 Sep 01 05:43:20.324169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 449/880] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:20.882140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:20.894760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:20.895639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:20.896232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:20.912020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] Creating event network-changed:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:43:20.915223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-8072a420-e8db-47f8-aee5-5f2ab2854ff9 req-028c0f8f-854e-4991-9505-8897b1e857c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038753 Sep 01 05:43:20.915816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 432/881] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:21.055700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:21.056404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:21.064184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.072333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.072333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.072333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.072333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.072741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.212536 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:21.222677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ebe11eac-ae20-4649-90f2-6f3f9aaa54a4 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.171642 Sep 01 05:43:21.234345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 450/882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:21 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:21.304696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:21.305395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:21.311751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.312170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.312606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.313553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.314176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.314600 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.463588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:21.476674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:21.478350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:21.479565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6c653d0e-6ef8-4bd2-8417-29bfe72a3d4d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.179184 Sep 01 05:43:21.480658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 433/883] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:21 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:22.244776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:22.245372 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:22.251964 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.253426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.253882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.254575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.255017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.255435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.392742 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:22.400802 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b9959c1-b649-46e5-ad8e-8d6d27491b64 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.159683 Sep 01 05:43:22.401664 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 451/884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:22 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:22.506910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:22.507492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:22.514244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.514728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.515153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.515841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.516282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.519713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.668387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:22.678963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:22.680426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:22.681592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2012ba0b-48fd-47d7-a141-5b03f8cab9fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.179504 Sep 01 05:43:22.682456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 434/885] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:22 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:23.424729 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:23.425419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:23.431933 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.432418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.432847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:23.433607 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.434089 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.434503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:23.651409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1460776777", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1165489474", "security_groups": [{"name": "tempest-secgroup-smoke-136845086"}], "networks": [{"uuid": "62987290-1af3-458a-a46f-e6f081bb2f99"}], "block_device_mapping_v2": [{"uuid": "96c72455-89d5-47db-98e3-7f8601279e74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:23.873148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] validate_networks() for [('62987290-1af3-458a-a46f-e6f081bb2f99', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:43:23.952139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:23.969989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9b240f62-3386-4323-a411-1349ef27f084 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.549018 Sep 01 05:43:23.970677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 452/886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:23 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:23.975494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:23.976338 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:23.982549 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.983299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.983960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:23.984904 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.985604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.986239 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:24.269691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:24.281878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:24.283790 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:24.285184 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8ba64214-70df-4c65-acfb-edbcf38522df tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.313306 Sep 01 05:43:24.300561 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 453/887] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:23 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:24.438357 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:43:24.438784 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:43:24.439256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:43:24.439666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:43:24.440625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:43:24.451070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:24.451564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:24.452001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:24.452743 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:24.453420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:24.453933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:24.480864 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Getting quotas for project 138f37da900443bea3ab358845a7c773. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:24.485818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Getting quotas for user 45e1b0901d174b10b49709d74d5fe5d6 and project 138f37da900443bea3ab358845a7c773. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:24.560066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:43:24.562311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96c72455-89d5-47db-98e3-7f8601279e74',volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:43:24.992402 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:24.996158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:25.004091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.005355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.005355 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.006083 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.006544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.006970 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.158051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.167416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b735c01-fa75-4c1c-83cb-4c78d24221a9 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.178945 Sep 01 05:43:25.168374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 454/888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:24 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:25.250809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-348be5ff-6d74-4f66-ac70-3d3d6c60cfa9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.603179 Sep 01 05:43:25.252971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 435/889] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:43:25.264193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-85d8925a-238d-4d3b-81d4-a2081f8aa789 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:25.265048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-85d8925a-238d-4d3b-81d4-a2081f8aa789 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:25.308792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:25.309403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:25.323407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.324124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.324822 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.325759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.326308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.326795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.352845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-85d8925a-238d-4d3b-81d4-a2081f8aa789 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.364301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-85d8925a-238d-4d3b-81d4-a2081f8aa789 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1089 microversion: 2.1 time: 0.103610 Sep 01 05:43:25.368549 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 455/890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:25 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1089 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:25.529927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.539392 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.540861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.542031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ac00c357-8edf-4717-ac62-fbd413c8b0af tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.237799 Sep 01 05:43:25.542597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 436/891] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:25 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:26.189057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:26.190155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:26.199314 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.200009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.200528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.201366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.201842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.202255 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.365266 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.373308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-46b75170-7f84-4ffc-8984-add7edc942d2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.188581 Sep 01 05:43:26.373911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 456/892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:26 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:26.386010 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-86d5882d-a1f8-4090-b833-6222a60e404f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:26.387333 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-86d5882d-a1f8-4090-b833-6222a60e404f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:26.446788 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-86d5882d-a1f8-4090-b833-6222a60e404f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.454879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-86d5882d-a1f8-4090-b833-6222a60e404f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1089 microversion: 2.1 time: 0.072716 Sep 01 05:43:26.468273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 437/893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:26 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:26.572240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:26.572855 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:26.584337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.584337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.584337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.584337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.584818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.584818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.725845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.734374 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.735824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.737568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0f733c4b-22eb-42b4-8741-42cf4aa2beac tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.168872 Sep 01 05:43:26.738127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 457/894] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:26 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:27.394244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:27.394872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:27.402307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.402791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.403248 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.403913 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.404354 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.404801 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.476191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:27.476801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:27.483229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.483708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.484132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.484823 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.485261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.485700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.559978 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.563510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:27.568280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ae5a4cfc-75b4-4a8e-ac9b-3b364162b7d1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1139 microversion: 2.1 time: 0.095925 Sep 01 05:43:27.568834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 458/895] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:27 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:27.577604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.591232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-949c5eb0-ee62-4b98-a71e-22e3a752d159 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.200614 Sep 01 05:43:27.591729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 438/896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:27 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:27.759942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:27.760537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:27.767069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.767539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.768444 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.769145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.769624 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.770040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.899317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.907247 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.908715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.909829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7d6ceb81-64d4-4266-9e17-abda8c75ccf8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.153760 Sep 01 05:43:27.910370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 459/897] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:27 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:28.601303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:28.601928 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:28.608458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.608933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.609358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.610086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.610674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.611086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.613040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:28.613742 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:28.619959 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.620458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.620880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.621578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.622063 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.622469 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.682287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:28.690466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fef686f5-068f-4d52-ac1a-fb16a933fe69 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1139 microversion: 2.1 time: 0.094100 Sep 01 05:43:28.691275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 439/898] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:28 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:28.771709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:28.779347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5d4d5a98-bb03-4525-96ba-4a58b625eda0 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.171241 Sep 01 05:43:28.779899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 460/899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:28 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:28.932281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:28.932881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:28.938871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.939341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.940283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.941317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.941795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.942209 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.071435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.079612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.082029 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.083140 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-695039eb-9abe-42ac-925c-d1f777a40bc5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.154968 Sep 01 05:43:29.083694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 440/900] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:28 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:29.711622 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:29.712243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:29.718314 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.718784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.719206 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.719878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.720316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.720722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.782175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.790613 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9d831a54-0823-4834-b780-cbcd0537bdbb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1139 microversion: 2.1 time: 0.082826 Sep 01 05:43:29.791167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 461/901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:29 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:29.801296 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:29.801941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:29.808272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.808745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.809171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.809883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.810325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.810737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.942518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.950472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7b327d9d-a19d-4d2c-b2e8-912034e49949 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.153838 Sep 01 05:43:29.951030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 441/902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:29 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:30.105682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:30.106390 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:30.113060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.113620 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.114098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.114860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.115368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.115817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.259074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:30.267531 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:30.269540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:30.270579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bc6e6657-f788-42eb-a5dc-95b4d4cc2185 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.169660 Sep 01 05:43:30.271420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 462/903] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:30 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:30.811385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:30.811975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:30.819461 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.819972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.820659 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.821348 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.821837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.822267 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.884915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:30.892510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bcd7be1a-6d71-43d8-9252-b1315da9d24e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1139 microversion: 2.1 time: 0.085038 Sep 01 05:43:30.893057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 442/904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:30 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:30.975368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:30.976204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:30.982599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.983060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.983479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.984149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.984583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.984989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:31.117086 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:31.125047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fbf072be-5ed3-4a09-b1dd-c011727eb43a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.153622 Sep 01 05:43:31.125633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 463/905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:30 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:31.343078 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:31.343706 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:31.350394 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:31.350865 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:31.351300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:31.351958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:31.352395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:31.352807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:31.484306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:31.493440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:31.505884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:31.505884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-19b97265-f9c3-4d2e-b70a-925a964b2682 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.205737 Sep 01 05:43:31.505884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 443/906] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:31 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:31.913543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:31.914256 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:31.920307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:31.920806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:31.921233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:31.921945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:31.922386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:31.922797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.021988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.030324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b882ae90-b1ac-4f69-b64a-dbcec8a09cf9 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1187 microversion: 2.1 time: 0.121554 Sep 01 05:43:32.030963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 464/907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:31 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:32.145952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:32.146565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:32.153298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.153821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.154257 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.154943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.155392 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.155809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.286869 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.294625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e1c74c82-fad9-4711-9b7c-1d3aaab37d32 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.152639 Sep 01 05:43:32.295190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 444/908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:32 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:32.526986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:32.527583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:32.533834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.534307 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.534726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.535393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.536567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.536986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.665437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.674347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.675777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.677659 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bfe25e2d-f11e-4668-8c23-d025a31ca890 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.154595 Sep 01 05:43:32.678224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 465/909] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:32 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:33.052076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:33.052678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:33.058628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.059099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.059522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.060197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.060635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.061044 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.130877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:33.139021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1d4bc4fc-f7c7-4a3b-947a-2bb1d2175917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1187 microversion: 2.1 time: 0.091121 Sep 01 05:43:33.139625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 445/910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:33 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:33.314510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:33.315056 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:33.322220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.322764 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.323196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.323928 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.324370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.324784 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.483872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:33.491874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c428875-de18-4c85-b49e-779c8c3e0946 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.181345 Sep 01 05:43:33.492423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 466/911] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:33 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:33.702962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:33.703571 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:33.710671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.711185 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.711617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.712304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:33.712747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:33.713164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:33.841786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:33.844081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:33.851037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:33.852713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:33.853815 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f12230e-4b6d-4793-b8de-7c4dee4b6dc0 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.154688 Sep 01 05:43:33.854366 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 446/912] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:33 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:34.160036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:34.161153 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:34.167378 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.167849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.168298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.168989 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.169426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.169866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.231327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:34.239905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f8e81a2a-53ff-4553-bb24-942fd2d15c32 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1195 microversion: 2.1 time: 0.083690 Sep 01 05:43:34.240454 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 467/913] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:34 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:34.512918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:34.513545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:34.515371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:34.520734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.521215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.521677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.522358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.522805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.523226 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.653520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:34.661715 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c78d98c8-e216-4e73-9d62-3a0c1526f000 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.152431 Sep 01 05:43:34.662281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 447/914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:34 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:34.876500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:34.877093 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:34.884007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.884478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.884898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.885591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.886057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.886465 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:35.012288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:35.020999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:35.022442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:35.023517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7b8d461a-9622-46b1-8d31-c10f1f5408b7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1407 microversion: 2.20 time: 0.150888 Sep 01 05:43:35.024055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 468/915] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:34 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:35.260878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:35.261397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:35.267895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:35.268371 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:35.268800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:35.269503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:35.269960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:35.270383 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:35.332200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:35.340287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4c3c9b65-7256-4417-9bb8-807cadaefdcb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1195 microversion: 2.1 time: 0.083069 Sep 01 05:43:35.340851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 448/916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:35 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1195 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:35.683238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:35.684721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:35.685756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=8 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:35.690477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:35.690953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:35.691377 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:35.692080 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:35.692525 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:35.692936 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:35.836175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:35.843713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e284bc39-f370-4e13-a848-41fc861a9697 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.164460 Sep 01 05:43:35.844268 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 469/917] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:35 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:36.045807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:36.046402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:36.053993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.054480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.054964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.055665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.056112 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.056722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.218183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:36.226768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:36.228194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:36.229350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ab64f7ac-5798-47e1-bae4-7dc19cc05371 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1599 microversion: 2.20 time: 0.187640 Sep 01 05:43:36.229950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 449/918] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:43:36 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:43:36.252004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:36.252568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:36.260024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.260500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.260925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.261643 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.262085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.262499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.366026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:36.366026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:36.366573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0f5db9a4-2f58-4ac0-9ec2-51bf65bdb81b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115991 Sep 01 05:43:36.366573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 470/919] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 1 05:43:36 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:43:36.369939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.370614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.371071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.371759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.372208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.372624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.451597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=14 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:36.460527 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:36.468950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c9f99550-e742-4ae2-ab71-069e2f872189 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1205 microversion: 2.1 time: 0.111426 Sep 01 05:43:36.483682 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 450/920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:36 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:36.866783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:36.867386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:36.874432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.875188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.875612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:36.876347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:36.876789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:36.877259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:37.137278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:37.144895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-200f2e36-54fa-411b-a384-3cc969dd011e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.283049 Sep 01 05:43:37.146106 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 471/921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:36 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:37.492677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:37.493358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:37.500655 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:37.501256 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:37.502293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:37.503088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:37.503638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:37.504283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:37.744057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:37.752546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c1fad672-1166-4c59-8384-f7c27e171dba tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.265177 Sep 01 05:43:37.753152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 451/922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:37 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:37.798039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:37.808367 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:37.809033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:37.809484 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:37.821841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] Creating event network-changed:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:43:37.827183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-59f8e0c3-b603-4550-89e1-403aea2d9933 req-d7f94ab0-e0ae-48bf-9c8c-b3f09223cd82 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093435 Sep 01 05:43:37.827926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 472/923] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:43:37.842307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:37.853206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:37.854030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:37.854670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:37.890419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] Creating event network-changed:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:43:37.896777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ff9b3b25-cd4c-4e3f-8180-dbcfd1c1c5c8 req-ce9b61f3-cae3-47e4-a59b-058f15993cb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058244 Sep 01 05:43:37.898055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 452/924] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:43:38.167994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:38.168685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:38.175932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:38.177018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:38.177524 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:38.178234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:38.178675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:38.179086 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:38.692544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:38.702098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9ad024ac-0055-4862-a48d-7e3583f80165 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.538381 Sep 01 05:43:38.709950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 473/925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:38 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:38.775601 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:38.776899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:38.784965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:38.786365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:38.786983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:38.787890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:38.788381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:38.788967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:39.105946 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:39.117526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5e5693ff-91d2-4868-bc45-3c2d0ab5d8ae tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.346864 Sep 01 05:43:39.129748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 453/926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:38 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:39.724482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:39.725419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:39.732240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:39.732719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:39.733147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:39.733867 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:39.734309 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:39.734723 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:39.753184 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "name": "network-vif-plugged", "status": "completed", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:39.762641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:39.763115 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:39.763542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:39.775737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] Creating event network-vif-plugged:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:43:39.781582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-8335e600-e3b4-49aa-8b3f-c09f286af843 req-d0593f5b-11aa-475f-9aad-7a397a7cd0a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Sep 01 05:43:39.782241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 454/927] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:39.872290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:39.880003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bfe72217-f6fd-4e85-9209-8010e7867e16 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.159946 Sep 01 05:43:39.880708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 474/928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:39 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:40.139567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:40.140250 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:40.147487 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:40.147957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:40.148382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:40.149056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:40.149526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:40.149941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:40.281344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:40.291172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-69831e2e-f86b-459e-9d91-543bf716fc30 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.155742 Sep 01 05:43:40.291817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 455/929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:40 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:40.900533 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:40.901050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:40.907542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:40.908044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:40.908470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:40.909145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:40.909626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:40.910037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:41.036816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:41.044460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2be70ab3-bc0f-4a16-9956-8cd5f0ebeb17 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.147867 Sep 01 05:43:41.045014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 475/930] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:40 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:41.312621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:41.313134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:41.320565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:41.321050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:41.321501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:41.322189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:41.322638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:41.323057 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:41.455461 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:41.463217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d6714774-9153-4958-86af-5ce2d5903a33 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.154588 Sep 01 05:43:41.463783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 456/931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:41 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:42.064655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:42.065200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:42.072294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:42.072862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:42.073294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:42.074007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:42.074449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:42.074861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:42.094473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:42.213027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:42.220854 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-36a30b94-6012-4651-9a7b-a5ed53dfa446 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1356 microversion: 2.1 time: 0.160130 Sep 01 05:43:42.221413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 476/932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:42 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:42.484476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:42.486612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:42.491397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:42.491888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:42.492345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:42.493037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:42.493516 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:42.493944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:42.631262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:42.639036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5a282112-caf4-49c1-beb0-a081bd9f595d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.158602 Sep 01 05:43:42.639607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 457/933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:42 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:43.242403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.243005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:43.249476 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.249962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.250387 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.251062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.251502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.251914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.380422 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:43.388130 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-84dd2b1b-cf89-4705-b4ab-70b60cfb349c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1546 microversion: 2.1 time: 0.150388 Sep 01 05:43:43.388683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 477/934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:43.407882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.408495 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:43.414956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.415435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.415869 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.416551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.416998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.417414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.546877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:43.555040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d3a61635-1184-4283-909f-4d43a237512b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1546 microversion: 2.1 time: 0.150938 Sep 01 05:43:43.555596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 458/935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:43.574987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.579804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:43.580553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Searching by: {'deleted': False, 'project_id': '1f39d8d2806b485984009aab93cb6f9d'} {{(pid=121031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:43:43.587691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.588169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.588592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.589309 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.589774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.590189 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.660206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.661521 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:43.667575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.668126 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.668622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.669411 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.669972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.670457 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.680827 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.multi_cell_list [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:43:43.822394 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:43.830740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-20752ed4-98e4-46a0-9f04-96366da70269 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.174216 Sep 01 05:43:43.831569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 459/936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:43.932012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-36094929-079d-48df-b05f-5c2f2ce593dd tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.360653 Sep 01 05:43:43.932587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 478/937] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers => generated 341 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:43.943740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.944342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:43.946641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:43.951342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.951816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.952243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.952917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.953359 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.953797 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:44.084025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:44.092074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3fb5d1ba-bbf1-4bc9-8ed0-86e943dd8811 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1546 microversion: 2.1 time: 0.152217 Sep 01 05:43:44.092637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 460/938] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:44.853238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:44.853879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:44.860935 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:44.861403 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:44.862168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:44.862883 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:44.863339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:44.864552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:44.998392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:45.006577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ec1359a7-a59f-488c-b68f-ce7c1584018b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.159038 Sep 01 05:43:45.007129 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 479/939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:44 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:46.026765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:46.027459 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:46.034183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:46.034662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:46.035089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:46.036631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:46.037076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:46.037518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:46.171721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:46.180244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-05376baf-5b16-47de-b260-4e740fc30560 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.157337 Sep 01 05:43:46.180799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 461/940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:46 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:47.154963 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30eb8ab3-8437-4880-ac1b-c9e7afe2942b"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:47.157233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:47.159646 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:47.164320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.164799 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.165227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.165940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.166426 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.166801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.201053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:47.201638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:47.208113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.208682 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.209114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.209853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.210301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.210729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.348900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:47.356740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9bd366bc-7cf0-4c89-b439-697d24cdfea4 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.159679 Sep 01 05:43:47.357308 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 462/941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:47 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:47.919547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-815e8687-0633-4fd0-b60c-8475addfc9d1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763402 Sep 01 05:43:47.919547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 480/942] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 1 05:43:47 2022] POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:48.377639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:48.378254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:48.385554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:48.387448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:48.387448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:48.387448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:48.387739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:48.387973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:48.524852 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:48.532645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b4709daa-ec32-41e0-94f1-d9c55876ea52 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.158926 Sep 01 05:43:48.533219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 463/943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:48 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:49.555579 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:49.556291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:49.562431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:49.562900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:49.563321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:49.563991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:49.564427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:49.564837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:49.699467 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:49.707016 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-47c795f2-fa58-4155-8327-ab37d31d3016 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.156749 Sep 01 05:43:49.707566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 481/944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:49 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:49.807163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "name": "network-vif-plugged", "status": "completed", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:49.816966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:49.818165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:49.818892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:49.829883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] Creating event network-vif-plugged:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:43:49.834836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-e53a28a6-1155-4855-8f85-75e51a55a88f req-2a0f073f-c357-4d39-a40d-c4a9b00671cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031735 Sep 01 05:43:49.835401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 464/945] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:50.730782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:50.731417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:50.737875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:50.738362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:50.738795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:50.740170 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:50.740786 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:50.741211 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:50.870275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:50.877837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2d6be128-98af-4159-be8c-152f8ce8ea21 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.150892 Sep 01 05:43:50.878380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 482/946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:50 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:51.900093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:51.900709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:51.906850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:51.907326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:51.907756 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:51.908431 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:51.908877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:51.909293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:51.925148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:52.048828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:52.057241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-246a8d6a-d852-4afa-aa99-66f6de41475d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1260 microversion: 2.1 time: 0.162443 Sep 01 05:43:52.057840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 465/947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:51 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:53.079852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:53.080392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:53.087495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.087977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.088405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.089081 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.089547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.089962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.228738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:53.237541 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bc9ef3ed-a3f9-43a4-8452-8557967ebe2e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1443 microversion: 2.1 time: 0.161649 Sep 01 05:43:53.241537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 483/948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:53 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:53.259317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:53.259920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:53.266359 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.266877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.267301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.267975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.268420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.268830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.401496 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:53.409290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-87da2a09-13c2-4038-b322-8e7741d3dbbf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1443 microversion: 2.1 time: 0.154743 Sep 01 05:43:53.409895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 466/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:53 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:55.349420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:55.360471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:55.363060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:55.363535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:55.363960 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:55.377704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] Creating event network-changed:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:43:55.383432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-326d3a27-dea7-4c2d-be1a-b5150e8a9ca5 req-3371f55b-2b9c-4437-889c-850a526f296e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037935 Sep 01 05:43:55.384035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 484/950] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:56.569219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:56.569899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:56.576622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.577100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.577572 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:56.578260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.578702 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.579118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:56.712761 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:56.721118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e45e092d-bcb3-49f7-bc30-9146a4b41033 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1592 microversion: 2.1 time: 0.156415 Sep 01 05:43:56.721710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 467/951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:56 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:59.088271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:59.098902 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:59.102612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:59.102612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:59.111575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] Creating event network-changed:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:43:59.116939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-59b5bbc1-37a7-4d64-b023-2eeb0963eb51 req-bb7b4b26-33f5-40d8-8445-9205719511ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033957 Sep 01 05:43:59.117791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 485/952] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:01.959364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1095388851"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:01.960089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:01.966683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:01.967166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:01.967596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:01.968279 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:01.968741 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:01.969148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:02.101221 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.network.security_group_api [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Adding security group 620f2fa6-dd14-49d1-a1c9-6c4861b10715 to port 86f14b72-da01-449d-bae8-dad462b6acab Sep 01 05:44:02.460990 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dc6c6c07-b10b-4c48-b4a3-4537630eb768 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action" status: 202 len: 0 microversion: 2.1 time: 0.505430 Sep 01 05:44:02.461894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 468/953] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:44:01 2022] POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:44:02.470214 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:02.470501 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:02.471253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:02.478828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:02.479390 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:02.479895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:02.480199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:02.480705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:02.481212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:02.481526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:02.481808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:02.482273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:02.495306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] Creating event network-changed:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:44:02.502615 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-146b5bae-4ef5-4e40-abba-617791bdc196 req-e394546b-041a-4c65-97f5-8954d1026ba7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 Sep 01 05:44:02.503225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 469/954] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:02.746233 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:02.755560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c0861af5-e236-443e-affa-7a263df95fc5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1758 microversion: 2.1 time: 0.289182 Sep 01 05:44:02.756182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 486/955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:02 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1758 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:44:52.985750 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=19 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:52.986475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=21 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:52.991515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:52.998475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:52.999302 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:52.999776 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.000198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.000870 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.001307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.001750 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.024428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8c446ef7-25e2-4077-8756-baba049513e8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/ips" status: 200 len: 152 microversion: 2.20 time: 0.040440 Sep 01 05:44:53.027183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 470/956] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 1 05:44:52 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:44:56.103220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:56.103848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:56.106686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=13 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:56.107357 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:56.108642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:44:56.108788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/action (ip 10.222.0.42) !!! Sep 01 05:44:56.119817 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.123157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.123157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.123157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.123157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.123551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.146911 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lazy-loading 'flavor' on Instance uuid d4160389-3d85-4389-9cd4-84b0440b1e4e {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:44:56.588273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-01ee7af8-6104-46f2-9d9b-b0172071ae5c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/action" status: 202 len: 0 microversion: 2.20 time: 0.488791 Sep 01 05:44:56.589438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 487/957] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 1 05:44:56 2022] POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:44:56.597895 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:56.598564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:56.605832 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.606298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.606729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.607439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.607883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.608301 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.742739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:56.750835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:56.755949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:56.755949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ebe81177-b188-4365-bc8c-296fbfe5ecff tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.159633 Sep 01 05:44:56.755949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 471/958] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:44:56 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:44:57.778071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:57.778769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:57.784968 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:57.785442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:57.785903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:57.786584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:57.787034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:57.787451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:57.921967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:57.930115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:57.931550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:57.932700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c7a9eaeb-926a-4c95-aafa-204a1e3abdf6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.159787 Sep 01 05:44:57.933249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 488/959] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:44:57 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:44:58.955465 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:58.956053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:58.962644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.963114 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.963536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.964208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.964688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.965289 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:59.098277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:59.106376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:59.107791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:59.108969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b799377c-0b56-4e9f-84dc-897e73524e6a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.157381 Sep 01 05:44:59.109549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 472/960] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:44:58 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:00.132261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:00.132866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:00.140256 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:00.140740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:00.141167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:00.141884 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:00.142330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:00.142746 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:00.374795 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:00.383363 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:00.384776 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:00.386047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-949cd478-cedf-458c-b5e1-d460e9820f83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.257739 Sep 01 05:45:00.387227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 489/961] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:00 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:01.256323 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:01.258664 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:01.266105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.266581 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.267008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.267691 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.268136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.268550 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.410964 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:01.411569 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:01.418866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.419386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.419816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.420595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.421047 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.421478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.552420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:01.560714 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:01.562253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:01.563502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-93e48c05-0185-447a-8084-d71cde5a68a5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.156391 Sep 01 05:45:01.564033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 490/962] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:01 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:01.639124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f1155381-7995-4b6c-8c4d-0f2e1ddb64ad tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action" status: 202 len: 0 microversion: 2.1 time: 0.386409 Sep 01 05:45:01.639820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 473/963] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:45:01 2022] POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:45:01.647949 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:01.648572 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:01.655866 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.656348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.656775 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.657480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:01.657926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:01.658339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:01.837257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:01.845575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2e80ed2e-31bf-4ff4-bc5b-68c06283519c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1750 microversion: 2.1 time: 0.201442 Sep 01 05:45:01.846133 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 491/964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:01 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1750 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:02.587992 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:02.588681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:02.596154 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:02.596628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:02.597099 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:02.597800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:02.598243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:02.598656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:02.736850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:02.745118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:02.747413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:02.748573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c074e4ac-b334-4b1b-b6c5-1b917935fee4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.165383 Sep 01 05:45:02.749125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 474/965] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:02 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:02.866988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:02.867583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:02.874172 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:02.874638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:02.875055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:02.875723 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:02.876159 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:02.876563 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:03.020471 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:03.029327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c1fc6ce1-a02d-4717-845f-e125e3037518 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.166251 Sep 01 05:45:03.029921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 492/966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:02 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:03.771614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:03.772217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:03.779440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:03.779916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:03.780358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:03.781039 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:03.781524 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:03.781950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:03.918830 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:03.926926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:03.928351 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:03.929533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-54aa1288-ef43-4958-a88d-09036c135828 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.161880 Sep 01 05:45:03.930089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 475/967] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:03 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:04.051246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:04.051840 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:04.058414 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:04.059102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:04.059545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:04.060219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:04.060658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:04.061066 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:04.204302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:04.212546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8e7d4d30-47f0-4bb0-a8ff-9e469ee81e81 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.165125 Sep 01 05:45:04.216560 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 493/968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:04 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:45:04.952722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:04.953349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:04.959788 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:04.960255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:04.960673 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:04.961342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:04.961809 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:04.962220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.090237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.098545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.099968 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.101353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-903adf89-9a11-4a6d-9480-8f9abc4ad08a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.152762 Sep 01 05:45:05.101927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 476/969] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:04 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:05.234891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:05.235413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:05.241843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.242311 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.242735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.243405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.243841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.244251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.383530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.392477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dcb40497-e46a-4a35-9d23-8d9540f4423f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.162256 Sep 01 05:45:05.393042 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 494/970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:05 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:06.124651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:06.125283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:06.131729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.132200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.132628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.133305 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.133780 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.134198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.266113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.274167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.275587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.276740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9e5305bb-6976-4e9d-8610-b2f46173b1e7 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.156060 Sep 01 05:45:06.278088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 477/971] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:06 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:06.412649 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:06.413155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:06.419684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.420162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.420584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.421261 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.421728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.422147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.562382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.571156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8f11a98f-e257-46a0-98f7-21b30e038c8e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.162191 Sep 01 05:45:06.571721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 495/972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:06 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:07.300471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:07.301093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:07.307697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.308765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.309214 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.309956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.310399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.310816 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.444535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:07.453347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:07.454808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:07.455964 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-712cc02d-acd8-4c0c-bd87-3ea891118825 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.159487 Sep 01 05:45:07.456522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 478/973] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:07 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:07.592037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:07.592631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:07.599198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.599665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.600085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.600752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.601188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.601716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.741994 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:07.750806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cc99edab-164e-4826-8b7a-b96b92b092f5 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.162683 Sep 01 05:45:07.751354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 496/974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:07 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:08.478512 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:08.479025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:08.486085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.486565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.486993 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.487683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.488125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.488542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.617550 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:08.626485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:08.627915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:08.629071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ed515987-46b6-487c-8230-176caed409c6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.154572 Sep 01 05:45:08.629648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 479/975] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:08 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:08.772243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:08.772878 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:08.779873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.780372 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.780812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.781672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.782121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.782535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.925190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:08.933515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c12f8a24-7db6-476d-a4b1-21a003d869ce tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.165152 Sep 01 05:45:08.934075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 497/976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:08 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:09.650979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:09.651581 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:09.658186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.659401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.659401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:09.659753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.660187 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.660602 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:09.790111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:09.798179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:09.799735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:09.800890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ee7d7061-e3a5-416d-92fa-72c32824e013 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.153815 Sep 01 05:45:09.801445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 480/977] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:09 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:09.955004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:09.955539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:09.961943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.962420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.962849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:09.963523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.963966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.964431 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:10.106175 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:10.114587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2eb997ef-4f90-43cf-a108-cd54b1208d98 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.163535 Sep 01 05:45:10.115162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 498/978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:09 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:10.827604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:10.828456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:10.838677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:10.839534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:10.840225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:10.841267 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:10.842128 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:10.842555 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:10.996554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:11.005764 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:11.007210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:11.008376 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c08a5d78-81f4-4d49-a098-2881332a6c15 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.188203 Sep 01 05:45:11.008962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 481/979] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:10 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:11.136400 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:11.137127 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:11.144961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:11.145441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:11.145912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:11.146896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:11.148298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:11.148727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:11.297754 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:11.305995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-243c1c54-f1ad-4788-bf09-d34cc26fa738 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.173691 Sep 01 05:45:11.309425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 499/980] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:11 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:12.036288 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:12.037246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:12.048247 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.049120 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.049953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:12.051155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.051922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.052722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:12.189971 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:12.198284 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:12.200875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:12.202076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9a65f49f-a03c-4d12-94a2-b1801274e47d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.170707 Sep 01 05:45:12.202631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 482/981] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:12 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:12.328459 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:12.329011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:12.335595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.336070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.336494 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:12.337235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.337745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.338192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:12.475929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:12.485530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1356ae9c-91cb-4d20-b945-e08af8b1176e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.161184 Sep 01 05:45:12.485530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 500/982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:12 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:13.226110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:13.226732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:13.233535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:13.234012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:13.234439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:13.235116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:13.235562 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:13.235978 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:13.367201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:13.376167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:13.377626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:13.378784 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-77435448-2b2b-498f-b301-2b56f0ec5237 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.156700 Sep 01 05:45:13.379342 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 483/983] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:13 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:13.505336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:13.505894 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:13.513067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:13.513587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:13.514020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:13.514705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:13.515156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:13.515573 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:13.533533 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:13.658397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:13.666633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-648754c6-f10e-4b59-9f83-534d008564ef tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.165188 Sep 01 05:45:13.667183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 501/984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:13 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:14.402270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:14.402833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:14.409447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.409957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.410387 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.411072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.411523 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.411943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.545429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:14.554944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:14.556381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:14.557680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8f3a6bc2-a649-40b4-9ed5-42c613b08675 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.159390 Sep 01 05:45:14.559079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 484/985] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:14 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:14.688747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:14.689329 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:14.696001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.696472 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.696897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.697628 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.698079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.698535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.844174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:14.852339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-939e216f-ee1a-4794-985e-58873dae783a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.167429 Sep 01 05:45:14.852897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 502/986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:14 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:15.581353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:15.581979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:15.588408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.588884 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.590016 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:15.590742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.591189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.591606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:15.742290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:15.745881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:15.750883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:15.752307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:15.753469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c3d6a990-b7b8-4d51-a4bd-da8e47b0892a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.176074 Sep 01 05:45:15.754031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 485/987] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:15 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:15.873014 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:15.873629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:15.881157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.881665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.882088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:15.882761 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.883197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.883604 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.025891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:16.035181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5631b3c5-0ee3-4e76-a4a7-4eb73bd93a09 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.166270 Sep 01 05:45:16.035773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 503/988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:15 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:16.226166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "name": "network-vif-plugged", "status": "completed", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:16.236939 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:16.239433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:16.239433 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.249364 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] Creating event network-vif-plugged:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:45:16.254486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-6cd74c64-c4b8-4092-873e-441c2f32c735 req-dc9d4ca9-e18a-4603-b257-b7f29642dd5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032509 Sep 01 05:45:16.255068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 486/989] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:16.776164 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:16.777428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:16.783594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:16.784059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:16.784489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.785174 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:16.785656 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:16.786077 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.911915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:16.920835 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:16.922299 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:16.923459 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-08129f88-cb20-4a9a-80e2-320038902be1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.151209 Sep 01 05:45:16.924009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 504/990] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:16 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:17.059291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:17.059892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:17.066758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.067237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.067668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.068352 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.068804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.069222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.216453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:17.224795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8462d915-76d4-4166-9edb-173a39cf026a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.170767 Sep 01 05:45:17.225363 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 487/991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:17 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:17.946712 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:17.947257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:17.954224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.954692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.955115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.955788 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.956225 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.956641 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:18.083478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:18.091929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:18.093335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:18.094501 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e762ddb-4866-4564-8654-f18162c6a0f1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.152028 Sep 01 05:45:18.095055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 505/992] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:17 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:18.250955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:18.250955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:18.253129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:18.253658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:18.254093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:18.254777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:18.255225 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:18.255643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:18.410526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:18.419263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-6d89f7c9-82de-4ea0-8013-55826eed988b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1755 microversion: 2.1 time: 0.177073 Sep 01 05:45:18.419846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 488/993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:18 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:19.117798 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.118411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.125053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.125570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.125991 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.126676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.127122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.127550 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.262510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.270792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.272110 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.273449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-89dd4bc3-6467-4969-9c7f-fe60a2a865f6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1745 microversion: 2.20 time: 0.159706 Sep 01 05:45:19.274011 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 506/994] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:19.440823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.441378 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.448179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.448687 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.449113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.449833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.450287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.450704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.595718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.603947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fb8a5ee1-c0d9-420d-ac33-a5857cbd48f1 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1758 microversion: 2.1 time: 0.167070 Sep 01 05:45:19.604510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 489/995] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:20.300057 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:20.300984 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:20.309580 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:20.310584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:20.311118 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:20.311885 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:20.312395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:20.312874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:20.462943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:20.472385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:20.474308 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:20.475711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-574bfb6b-0284-472b-b8aa-aaa4908a198f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.181908 Sep 01 05:45:20.476264 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 507/996] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:20 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:21.499193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:21.499827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:21.506648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:21.507132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:21.507565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:21.508260 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:21.508825 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:21.509468 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:21.664182 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:21.673142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:21.674701 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:21.675934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f8686acf-5f4b-434f-9e42-3adb1274bec3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.181152 Sep 01 05:45:21.676937 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 490/997] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:21 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:22.700205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:22.700863 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:22.707488 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:22.708055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:22.708589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:22.709290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:22.709771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:22.710181 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:22.846464 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:22.855896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:22.857345 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:22.858647 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cea4c249-927c-4372-a5f7-e8085640b3c1 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.163680 Sep 01 05:45:22.859243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 508/998] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:22 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:23.882152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:23.882756 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:23.887084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=43 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:23.890646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:23.891124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:23.891548 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:23.892228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:23.892667 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:23.893074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:24.038921 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:24.048733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:24.050421 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:24.052540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dfc02416-25ff-44ee-a492-f7913ef14aa8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.173066 Sep 01 05:45:24.067661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 491/999] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:23 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:25.077115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:25.077693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:25.084253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:25.084739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:25.085171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:25.086055 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:25.086508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:25.086925 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:25.235940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:25.246437 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:25.248001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:25.249162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5ee2ced5-469d-401d-be6e-2eb8973b9cc8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.176627 Sep 01 05:45:25.249758 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 509/1000] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:25 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:26.275728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:26.277132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:26.284042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:26.284627 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:26.285139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:26.286092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:26.286607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:26.287116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:26.427089 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:26.436118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:26.437582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:26.438941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-32992e9b-fe19-426c-b02a-c18ecb839d98 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.167593 Sep 01 05:45:26.453951 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 492/1001] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:26 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:27.466043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:27.466657 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:27.469112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=47 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:27.473954 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:27.474672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:27.475321 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:27.476262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:27.476778 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:27.477201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:27.618001 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:27.627597 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:27.629229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:27.630508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e45d54d-276e-43bb-9c71-8eb8044b0594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.169110 Sep 01 05:45:27.631078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 510/1002] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:27 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:28.654857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:28.655460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:28.662020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:28.662483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:28.662917 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:28.663603 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:28.664049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:28.664466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:28.816407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:28.826840 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:28.828322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:28.829696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c090af78-08d5-44ae-a602-5d7036cf0e2d tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.179610 Sep 01 05:45:28.830334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 493/1003] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:28 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:29.856806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:29.857419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:29.864112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.864892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.865587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:29.866521 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.867031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.867663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:30.027828 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:30.035903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:30.037337 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:30.038545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-11d2db3b-ceb9-4ec0-aee6-6fc71d7ab84b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.186366 Sep 01 05:45:30.039065 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 511/1004] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:29 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:31.062878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:31.063442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:31.069867 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.070345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.071032 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.071714 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.072161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.072580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.206877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:31.215857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:31.217275 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:31.218635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f6dc4f5a-9c0b-4d6e-88d7-5cdb41ee8c9b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1740 microversion: 2.20 time: 0.159759 Sep 01 05:45:31.219194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 494/1005] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:31 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:32.241846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:32.242396 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:32.249613 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.250173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.250618 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.251297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.251739 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.252146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.383192 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:32.393085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:32.394533 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:32.395680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-893acc07-06d5-48cd-8409-8cb951873abe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1722 microversion: 2.20 time: 0.157906 Sep 01 05:45:32.396228 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 512/1006] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:32 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:33.419450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:33.420036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:33.426336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:33.426805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:33.427229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.427898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:33.428337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:33.428747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.560158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:33.568227 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:33.569707 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:33.571113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fb30d09a-aa04-4e0f-b3e1-49b0c75543d5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1722 microversion: 2.20 time: 0.155594 Sep 01 05:45:33.571662 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 495/1007] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:33 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:34.255837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "name": "network-vif-unplugged", "status": "completed", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:34.266485 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.266945 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.267354 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.279633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] Creating event network-vif-unplugged:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:45:34.284686 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-73e2a040-f322-4ad6-bf0c-b0a997f54e95 req-b02bba19-3c3f-46a4-b1ab-bece103c26a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032977 Sep 01 05:45:34.285346 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 513/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:34.593944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:34.594592 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:34.601049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.601588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.602017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.602693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.603137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.603552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.734742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:34.742882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:34.744310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:34.745556 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e7b5c2c9-4b7e-45f7-b564-44f735b6d7fd tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1725 microversion: 2.20 time: 0.155472 Sep 01 05:45:34.746183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 496/1009] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:34 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:34.774364 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601a2b05-0668-4004-919f-85e83c294ecd"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:34.777747 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:34.784079 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.784545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.784962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.785704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.786141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.786551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.673022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5c486a27-d240-407e-a3d1-8de66f924fc3 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.902905 Sep 01 05:45:35.678992 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 514/1010] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 1 05:45:34 2022] POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments => generated 188 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:45:35.794583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:35.795088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:35.801407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.801910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.802337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.803015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.803458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.803881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.312975 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4738de99-1e21-41e5-b8c0-951b29e361fa tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments/601a2b05-0668-4004-919f-85e83c294ecd" status: 202 len: 0 microversion: 2.20 time: 0.522745 Sep 01 05:45:36.313510 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 497/1011] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 1 05:45:35 2022] DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments/601a2b05-0668-4004-919f-85e83c294ecd => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:45:36.372633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:36.373257 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:36.379882 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.380362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.380789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.381500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.381950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.382368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.470789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121031) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:45:36.578336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:36.722294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cdcee460-13df-4ceb-b768-ea8e20852f6c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/action" status: 202 len: 0 microversion: 2.20 time: 0.353745 Sep 01 05:45:36.722947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 515/1012] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 1 05:45:36 2022] POST /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:45:36.731379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:36.731987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:36.738017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.738506 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.738931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.739649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.740090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.740507 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.873137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:36.881204 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:36.882647 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:36.883811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2c933f6b-4a91-4a64-a1b5-fd87c36b5632 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1673 microversion: 2.20 time: 0.156530 Sep 01 05:45:36.884344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 498/1013] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:36 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:37.908436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:37.909031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:37.915061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:37.915539 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:37.915961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:37.916637 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:37.917078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:37.917590 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:38.048260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:38.056425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:38.057875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:38.060009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9f86a80f-570a-4597-9810-73521cb3be5f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1675 microversion: 2.20 time: 0.156158 Sep 01 05:45:38.060552 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 516/1014] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:37 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:39.084157 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:39.084782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:39.091151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:39.091625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:39.092056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:39.092762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:39.093201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:39.093652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:39.327712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:39.335783 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:39.338217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:39.338393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b7ddd670-25ac-4cf7-9ffc-811105028824 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.258124 Sep 01 05:45:39.338954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 499/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:39 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:40.361829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:40.362562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:40.369478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:40.369966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:40.370394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:40.371638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:40.372082 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:40.372497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:40.514276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:40.522765 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:40.524445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:40.525625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-93118e77-69bb-4928-9745-cd1145e95345 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.167698 Sep 01 05:45:40.526178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 517/1016] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:40 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:41.548611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:41.549368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:41.555873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.556356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.556786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.557501 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.557952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.558427 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.762912 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:41.765092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:41.772883 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:41.775219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:41.777420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f7dc16dc-6669-4c83-bfa4-c783855bc842 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.232058 Sep 01 05:45:41.779637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 500/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:41 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:42.805416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:42.807202 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:42.816254 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.817416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.818102 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:42.819040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.819701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.820564 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:43.028288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:43.037092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:43.038590 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:43.039748 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-faf6d19a-b51c-4c52-98c1-c4fd2421bcbe tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.241038 Sep 01 05:45:43.040296 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 518/1018] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:42 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:44.063911 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:44.064492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:44.071838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.072316 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.072747 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.073434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.074718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.075147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.229834 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:44.239810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:44.241385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:44.242880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c4ca5c78-bd8d-4959-a4c0-bb31e0281194 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.182973 Sep 01 05:45:44.245508 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 501/1019] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:44 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:45.268398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:45.269031 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:45.275985 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:45.276616 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:45.276877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:45.277608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:45.278151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:45.278566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:45.420591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:45.429163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:45.430548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:45.431706 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-981513b9-e2e9-442e-acc1-e1ae8aede548 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.167725 Sep 01 05:45:45.432605 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 519/1020] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:45 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:46.455253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:46.455817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:46.462851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.463327 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.463751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:46.464991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.465551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.465977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:46.605542 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:46.613837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:46.615286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:46.616598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c7faded8-966e-41e4-b1a0-8fd505a37d8a tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.165408 Sep 01 05:45:46.617153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 502/1021] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:46 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:47.639773 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:47.640405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:47.646907 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:47.647382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:47.647818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:47.648507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:47.648950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:47.649397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:47.803069 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:47.812391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:47.813836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:47.814980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0fe37b7a-d42e-44b7-91e9-e20e9886e277 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.179351 Sep 01 05:45:47.815528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 520/1022] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:47 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:48.840657 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:48.841268 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:48.847970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.848697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.849124 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.849844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.850293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.850901 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.983694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:48.992878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:48.994331 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:48.995491 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bd71ca38-df31-469b-81c9-ca563228c01c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.159014 Sep 01 05:45:48.996669 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 503/1023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:48 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:50.018606 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:50.019200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:50.025750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.026216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.026640 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.027359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.027793 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.028201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.160380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:50.168519 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:50.169909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:50.171044 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2cd2d2a5-f8f1-46a1-9696-971b7e4cbb1e tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.156318 Sep 01 05:45:50.171608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 521/1024] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:50 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:51.193847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:51.194478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:51.201217 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:51.201727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:51.202158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:51.202839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:51.203285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:51.203696 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:51.330947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:51.339025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:51.340521 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:51.341703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cdaa453b-3e65-4d89-ba5d-2a66cb78358f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.151771 Sep 01 05:45:51.346439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 504/1025] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:51 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:52.365000 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:52.365658 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:52.372797 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.373274 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.373730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.374415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.374858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.375296 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.504034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:52.512207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:52.513662 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:52.514811 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f69c2884-f7af-40af-bf75-3ce09c73f6f8 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.153787 Sep 01 05:45:52.515358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 522/1026] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:52 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:53.538135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:53.538716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:53.545738 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.546219 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.546649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:53.547329 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.547777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.548193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:53.679566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:53.688560 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:53.690081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:53.691196 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9685102e-3104-4169-84aa-0b0e8e6f937b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.157015 Sep 01 05:45:53.691751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 505/1027] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:53 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:45:54.714395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:54.715207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:54.721931 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.722408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.722857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.723547 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.723987 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.724401 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.856443 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.864482 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.865947 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.867096 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dad4fdf8-c3fe-48be-869d-beae270b6800 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.156658 Sep 01 05:45:54.867645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 523/1028] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:54 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:55.890350 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:55.890955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:55.893254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=30 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.897949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.898429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.898887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:55.899569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.900021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.900439 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:56.034292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:56.043001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:56.044449 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:56.045639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7e2dbd25-2501-4f72-8457-f02e016fbd09 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.159248 Sep 01 05:45:56.046206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 506/1029] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:55 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:57.068124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:57.068746 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:57.076026 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.076495 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.076918 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.077621 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.078060 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.078473 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.205520 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.213584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.215964 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.217121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-31c72c11-798e-40ed-8920-d7e1f8a37612 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.152922 Sep 01 05:45:57.217693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 524/1030] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:57 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:58.239804 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:58.240404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:58.247683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.248553 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.248674 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.249261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.249734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.250147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.384984 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:58.394252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:58.395628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:58.396851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-96ccf0d8-aaf9-4303-a6f8-4c4f410e82c5 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.160978 Sep 01 05:45:58.397413 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 507/1031] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:58 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:58.415750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "name": "network-vif-plugged", "status": "completed", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:58.422905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.426782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.427267 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.427682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.439611 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] Creating event network-vif-plugged:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:45:58.444858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-3bb1027b-7eef-4e0b-8116-9f3266378cea req-0d1a5997-ac1c-4703-85cc-c9265e311925 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Sep 01 05:45:58.445955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 525/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:45:59.421511 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:59.422108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:59.428475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:59.428946 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:59.429369 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:59.430069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:59.430509 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:59.430926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:59.571238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:59.579918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:59.581339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:59.582519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9cd85171-68ca-4b62-bf5a-31301c6c2fad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.166325 Sep 01 05:45:59.583071 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 508/1033] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:59 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:46:00.607767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:00.608425 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:00.615114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:00.615634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:00.616003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:00.616681 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:00.617119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:00.617625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:00.751996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:00.760091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:00.762120 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:00.763278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3c9e1f17-11e5-4fdc-beef-4056ababcb84 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1731 microversion: 2.20 time: 0.161263 Sep 01 05:46:00.763836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 526/1034] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:46:00 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:46:01.786954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:01.787535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:01.794595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:01.795069 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:01.795492 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:01.796174 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:01.796614 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:01.797027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:01.929192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:01.938236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:01.939575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:01.940735 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-5ca624de-604b-424e-b9e4-7bb8d2a4f9ad tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1718 microversion: 2.20 time: 0.157729 Sep 01 05:46:01.941299 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 509/1035] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:46:01 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:46:13.689161 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:13.689848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:13.692310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:13.692961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:13.698168 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:13.698652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:13.699642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:13.700415 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:13.700858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:13.701275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:13.728248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lazy-loading 'flavor' on Instance uuid d7ded019-447f-4f29-9d3b-d147ee305975 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:46:14.060324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e487982-9473-417b-86ee-5e8f33195c97 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "POST /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975/action" status: 202 len: 0 microversion: 2.1 time: 0.374798 Sep 01 05:46:14.060808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 527/1036] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:46:13 2022] POST /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:46:14.070003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:14.070620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:14.073094 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=7 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:14.073772 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=55 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:14.079232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:14.079717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:14.080148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:14.080867 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:14.081315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:14.081843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:14.221489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:14.229245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ec2d54e8-4d7f-4522-964d-e385d29d3817 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.163979 Sep 01 05:46:14.230522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 510/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:14 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:15.251546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:15.252240 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:15.258530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:15.259006 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:15.259435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:15.260112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:15.260556 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:15.260974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:15.389085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:15.396854 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-14036713-e40d-4585-bfe0-42560a80b421 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.150457 Sep 01 05:46:15.397421 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 528/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:15 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:16.418199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:16.418799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:16.425756 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:16.426241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:16.426672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:16.427359 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:16.427808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:16.428228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:16.562944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:16.571144 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a9bc795c-5bff-4571-bea6-bf6d057b0258 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.156534 Sep 01 05:46:16.572066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 511/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:16 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:17.593877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:17.594479 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:17.600908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:17.601435 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:17.601833 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:17.602501 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:17.602942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:17.603349 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:17.734136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:17.741889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5e8ba2ac-2c85-4cdd-aeb7-398e3db4da50 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.152783 Sep 01 05:46:17.742447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 529/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:17 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:18.762930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:18.763531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:18.769998 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:18.770467 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:18.770891 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:18.771561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:18.772021 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:18.772415 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:18.908346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:18.916377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-972b069b-08a7-4ed9-9b12-0791f396993a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.157425 Sep 01 05:46:18.917003 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 512/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:18 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:19.938526 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:19.939067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:19.945501 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:19.946187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:19.946608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:19.947278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:19.947713 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:19.948119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:20.079070 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:20.087583 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-11260d27-91a0-4a9b-af03-704a5eeb5aed tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.153582 Sep 01 05:46:20.088147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 530/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:19 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:21.109956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:21.110693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:21.116619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:21.118004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:21.118004 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:21.118294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:21.118718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:21.119132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:21.251283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:21.259070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-71c721fb-205c-4554-b17d-35abaa7e42cf tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.154148 Sep 01 05:46:21.259633 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 513/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:21 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:46:22.280488 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:22.281071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:22.287514 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:22.287986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:22.288408 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:22.289084 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:22.289557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:22.289969 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:22.422238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:22.430191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-adef75c0-2e11-405e-9927-0a99046ef905 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.154270 Sep 01 05:46:22.430746 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 531/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:22 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:23.234792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1095388851"}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:23.235374 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:23.241849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.242324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.242752 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.243429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.243875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.244291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.368261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.network.security_group_api [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Removing security group 620f2fa6-dd14-49d1-a1c9-6c4861b10715 from port 86f14b72-da01-449d-bae8-dad462b6acab Sep 01 05:46:23.452046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:23.452630 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:23.459056 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.459532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.459952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.460634 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.461071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.461504 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.679025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:23.687801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-34e2afe1-5882-4f06-8026-9c344e232c54 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.240030 Sep 01 05:46:23.688379 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 532/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:23 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:46:23.806030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-224f5623-2007-4e26-9781-769018716b0f tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action" status: 202 len: 0 microversion: 2.1 time: 0.575808 Sep 01 05:46:23.806642 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 514/1046] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:46:23 2022] POST /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:23.815693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:23.825848 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.826416 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.826898 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.845404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] Creating event network-changed:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:46:23.852633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-561c0499-3257-4b5e-909d-080382685438 req-2d4e6086-5983-4a66-908e-981c4b57ab4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040786 Sep 01 05:46:23.853394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 533/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:24.708949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:24.709644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:24.716454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:24.716930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:24.717599 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:24.718365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:24.718807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:24.719310 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.358633 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:25.366466 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-45192e02-cf2a-401a-9c7a-42e08ef9a4e5 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.662023 Sep 01 05:46:25.367036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 515/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:24 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:25.893708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:25.894245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:25.895236 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:25.901771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:25.902411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:25.902830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.903663 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:25.904106 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:25.904516 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.905409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:25.905931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:25.906580 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.918857 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] Creating event network-changed:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:46:25.924266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-8f3cb253-89af-4520-80da-00c38eb78c97 req-4eab3ad8-2822-448f-8662-aa55cb7e022e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033953 Sep 01 05:46:25.925270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 516/1049] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:46:25.990895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lazy-loading 'services' on Instance uuid bacb2cd7-7d63-4348-a2b7-bcea0d35609c {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:46:26.180513 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0fb7a469-7332-402b-8337-ca41f2d59334 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments/30eb8ab3-8437-4880-ac1b-c9e7afe2942b" status: 202 len: 0 microversion: 2.1 time: 0.291861 Sep 01 05:46:26.181024 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 534/1050] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:46:25 2022] DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments/30eb8ab3-8437-4880-ac1b-c9e7afe2942b => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:26.195945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:26.195945 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:26.200912 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.204638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.204638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.204638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.204638 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.205037 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.232880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a3d8f9a0-55f8-4c42-8f41-8ab0efa21ce2 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Sep 01 05:46:26.233447 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 517/1051] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:46:26 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:26.388317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:26.389008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:26.395113 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.395589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.396017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.396692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.397136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.397575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.530152 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:26.537998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2f2876d3-79d7-4e7c-8c0e-a58e100f229f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.153870 Sep 01 05:46:26.538768 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 535/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:26 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:27.245299 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:27.248056 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:27.254435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.254915 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.255345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:27.256027 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.256479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.256896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:27.285710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-44730da0-804b-4368-b74b-72740f95269d tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Sep 01 05:46:27.286274 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 518/1053] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:46:27 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:27.559424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:27.560033 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:27.566544 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.567028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.567457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:27.568145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.568593 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.569009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:27.712548 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:27.721270 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-db574c35-c769-4307-ac63-516e7e8dd2a7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.165663 Sep 01 05:46:27.721861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 536/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:27 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:28.298575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:28.300745 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:28.307113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:28.307590 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:28.308053 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:28.308734 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:28.309179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:28.309636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:28.339095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b498b5d1-0711-4818-acf1-1a4b14970a22 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 01 05:46:28.339649 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 519/1055] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:46:28 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:28.742297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:28.742900 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:28.749581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:28.750064 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:28.750532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:28.751214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:28.751685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:28.752098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:28.900615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:28.911538 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3f350412-d06e-4874-9076-5b6cf1a54122 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.172946 Sep 01 05:46:28.912117 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 537/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:28 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:29.351050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:29.353177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:29.360478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.360953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.361374 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.362073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.362515 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.362930 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.392081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fb5e24a6-6dd4-48e2-aba9-1597faf6092b tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045024 Sep 01 05:46:29.392628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 520/1057] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 1 05:46:29 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:46:29.403119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:29.404940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:29.409742 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.410216 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.410646 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.411327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.411771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.412186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.487949 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] HTTP exception thrown: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c is not attached to volume 30eb8ab3-8437-4880-ac1b-c9e7afe2942b Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Request method failure captured: Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments/30eb8ab3-8437-4880-ac1b-c9e7afe2942b HTTP/1.1 Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZdHkH-LP_cp00MpDdXhMK_AnhEp8LFgkyXzHpR_4P1hVsa_VlEgHpyPY4o8Y5hKubjimB69Y0PHKfis__HsZJaheMfkH6xD7Rdr4KE_ceykmOe-1YiErujWk7VTJFcg_Vl0aDPp_BvsIc8A-5qQBs6CPXqGnL6OOPUA3yzuM2gWLY Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 1f39d8d2806b485984009aab93cb6f9d Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:46:29.490331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1f39d8d2806b485984009aab93cb6f9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1f39d8d2806b485984009aab93cb6f9d Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-TestMinimumBasicScenario-147248485-project Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 196e0d38ea1d4669a3185cef7edef14a Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestMinimumBasicScenario-147248485-project Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:46:29.492107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c is not attached to volume 30eb8ab3-8437-4880-ac1b-c9e7afe2942b Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'server_id': 'bacb2cd7-7d63-4348-a2b7-bcea0d35609c', 'id': '30eb8ab3-8437-4880-ac1b-c9e7afe2942b'} Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 30eb8ab3-8437-4880-ac1b-c9e7afe2942b. Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:46:29.493085 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c is not attached to volume 30eb8ab3-8437-4880-ac1b-c9e7afe2942b Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c is not attached to volume 30eb8ab3-8437-4880-ac1b-c9e7afe2942b Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:29.494726 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Returning 404 to user: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c is not attached to volume 30eb8ab3-8437-4880-ac1b-c9e7afe2942b {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:46:29.496193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8e86609a-d438-456b-a0ad-2429e58f092c tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments/30eb8ab3-8437-4880-ac1b-c9e7afe2942b" status: 404 len: 154 microversion: 2.1 time: 0.092844 Sep 01 05:46:29.496193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 538/1058] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 1 05:46:29 2022] DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c/os-volume_attachments/30eb8ab3-8437-4880-ac1b-c9e7afe2942b => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:29.936888 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:29.937551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:29.943475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.943944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.944365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.945034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.945504 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.946180 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.076214 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:30.084337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-63125a35-c58e-4377-8408-49e8f39e5917 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1509 microversion: 2.1 time: 0.152107 Sep 01 05:46:30.084965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 521/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:29 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:30.104595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:30.105187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:30.112523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.112998 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.115631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.115631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.115631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.115631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.145727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121031) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:46:30.389819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-62aeb39d-2e00-4ea5-8884-b9dae71cca59 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "POST /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975/action" status: 202 len: 0 microversion: 2.1 time: 0.289027 Sep 01 05:46:30.393589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 539/1060] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 1 05:46:30 2022] POST /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:30.398730 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:30.399339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:30.414981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.416574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.416574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.416574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.417030 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.417643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.496626 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "name": "network-vif-unplugged", "status": "completed", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:30.505284 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.505889 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.506315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.518874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.compute.server_external_events [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] Unable to find a host for instance d7ded019-447f-4f29-9d3b-d147ee305975. Dropping event network-vif-unplugged {{(pid=121031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:46:30.519750 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-817ecc57-f7a0-4771-8af6-4065805f7e54 req-9e153e7f-c316-4e9c-968e-341a747370f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029593 Sep 01 05:46:30.520638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 540/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:46:30.566171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:30.574712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1a595baa-1c6b-48c3-bb5d-f34d57b45102 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1517 microversion: 2.1 time: 0.179656 Sep 01 05:46:30.575238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 522/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:30 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:30.736897 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:30.737500 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:30.743716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.744253 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.744702 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.745368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.745845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.746258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.766673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:30.773736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:46:31.038288 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-27e87255-fcac-466a-8dcb-b98f30fd186e tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 204 len: 0 microversion: 2.1 time: 0.305220 Sep 01 05:46:31.038876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 541/1063] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:46:30 2022] DELETE /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:46:31.047320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:31.047920 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:31.053817 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.054300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.054725 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.055403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.055846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.056259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.190898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:31.199186 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a92b89ec-9a71-4ecc-b821-90d47dfe5388 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1552 microversion: 2.1 time: 0.156035 Sep 01 05:46:31.199762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 523/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:31 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:31.596735 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:31.597423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:31.603766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.604234 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.604660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.605333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.605791 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.606199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.741803 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:31.750440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f4230f5f-6200-4585-ac22-e7cd4947881b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1517 microversion: 2.1 time: 0.157876 Sep 01 05:46:31.751002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 542/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:31 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:32.220695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:32.221297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:32.227833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.228307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.228733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.229408 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.229878 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.230293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.359046 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:32.366853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-75bf135b-aaea-459c-bd3a-e24fb4620e48 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1552 microversion: 2.1 time: 0.150116 Sep 01 05:46:32.367414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 524/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:32 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:32.770618 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:32.771213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:32.777661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.778138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.779220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.780183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.780629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.781040 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.925417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:32.933406 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8be700a5-983e-4f1e-a804-ab336a26bdc2 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1517 microversion: 2.1 time: 0.166560 Sep 01 05:46:32.933995 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 543/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:32 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:33.388866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:33.389486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:33.392102 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:46:33.392261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c (ip 10.222.0.42) !!! Sep 01 05:46:33.398709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.399190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.399644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.400339 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.400791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.401208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.564076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:33.572561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-07cf328b-07f0-4088-8c1d-ec28df90c26a tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1552 microversion: 2.1 time: 0.188267 Sep 01 05:46:33.573243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 525/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:33 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:33.755059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacb2cd7-7d63-4348-a2b7-bcea0d35609c", "name": "network-vif-deleted", "tag": "86f14b72-da01-449d-bae8-dad462b6acab"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:33.765051 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.765535 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.765950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.777394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] Creating event network-vif-deleted:86f14b72-da01-449d-bae8-dad462b6acab for instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c on hv-cinder-85220 Sep 01 05:46:33.783317 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-a71932a2-0770-4ff6-9603-56e59d4643ce req-9c3d328f-48d4-4c20-a8ef-ad78facd45be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031849 Sep 01 05:46:33.784193 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 544/1069] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:33.954173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:33.954704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:33.961401 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.962082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.962511 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.963458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.963853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.964271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:34.108628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:34.116844 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ec16dc03-b9cc-498a-8616-6d0c467cf834 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1519 microversion: 2.1 time: 0.167058 Sep 01 05:46:34.124049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 526/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:33 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:34.595588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:34.596277 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:34.602553 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:34.603028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:34.603903 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:34.604762 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:34.605205 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:34.605753 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:34.641092 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:34.641671 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:34.642093 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:34.642528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lazy-loading 'fault' on Instance uuid bacb2cd7-7d63-4348-a2b7-bcea0d35609c {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:46:34.684039 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196e0d38ea1d4669a3185cef7edef14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39d8d2806b485984009aab93cb6f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:34.693052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f97ee4da-cffc-4787-97db-7b020e699515 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 200 len: 1346 microversion: 2.1 time: 0.102344 Sep 01 05:46:34.693652 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 545/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:34 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:35.139107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:35.139850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:35.146535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:35.147015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:35.147440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:35.148118 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:35.148566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:35.148976 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:35.168139 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:35.359788 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:35.367651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-fd0e007c-07fb-44b2-88c7-b64ca50279a1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.232810 Sep 01 05:46:35.368232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 527/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:35 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:35.714443 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:35.715114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] [instance: bacb2cd7-7d63-4348-a2b7-bcea0d35609c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:35.722480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:35.722986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:35.723412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:35.724098 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:35.724546 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:35.724956 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:35.739527 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] HTTP exception thrown: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Request method failure captured: Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c HTTP/1.1 Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZdHkH-LP_cp00MpDdXhMK_AnhEp8LFgkyXzHpR_4P1hVsa_VlEgHpyPY4o8Y5hKubjimB69Y0PHKfis__HsZJaheMfkH6xD7Rdr4KE_ceykmOe-1YiErujWk7VTJFcg_Vl0aDPp_BvsIc8A-5qQBs6CPXqGnL6OOPUA3yzuM2gWLY Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 1f39d8d2806b485984009aab93cb6f9d Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:46:35.744157 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1f39d8d2806b485984009aab93cb6f9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1f39d8d2806b485984009aab93cb6f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1f39d8d2806b485984009aab93cb6f9d Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-147248485 Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-TestMinimumBasicScenario-147248485-project Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 196e0d38ea1d4669a3185cef7edef14a Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestMinimumBasicScenario-147248485-project Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. Sep 01 05:46:35.745865 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'bacb2cd7-7d63-4348-a2b7-bcea0d35609c'} Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:46:35.746834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. Sep 01 05:46:35.748943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:46:35.750412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Returning 404 to user: Instance bacb2cd7-7d63-4348-a2b7-bcea0d35609c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:46:35.750412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d796dd7a-3606-41be-a715-aee62350e450 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c" status: 404 len: 111 microversion: 2.1 time: 0.032027 Sep 01 05:46:35.750412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 546/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:35 2022] GET /compute/v2.1/servers/bacb2cd7-7d63-4348-a2b7-bcea0d35609c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:35.751820 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bd8571a8-637b-48ef-aa0d-b997fa6cd030 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] Calling method '.version_select at 0x7fbb6bab3790>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:35.850733 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bd8571a8-637b-48ef-aa0d-b997fa6cd030 tempest-TestMinimumBasicScenario-147248485 tempest-TestMinimumBasicScenario-147248485-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-248227819" status: 202 len: 0 microversion: 2.1 time: 0.102973 Sep 01 05:46:35.851233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 528/1074] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Sep 1 05:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-248227819 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:36.389845 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:36.390475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:36.392715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:46:36.392858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 (ip 10.222.0.42) !!! Sep 01 05:46:36.406022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:36.406497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:36.406915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:36.409636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:36.409636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:36.409636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:36.544147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:36.552145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f00d9e42-af06-4d0f-800b-6c3e6a8cdc9a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.167327 Sep 01 05:46:36.552700 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 547/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:36 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:37.576049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:37.576755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:37.582787 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:37.583263 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:37.583689 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:37.584368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:37.584839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:37.585251 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:37.727088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:37.738557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-53721cf8-fd49-484c-8d5f-5223b09c1212 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.167703 Sep 01 05:46:37.739285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 529/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:37 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:38.760369 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:38.761012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:38.767508 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:38.767979 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:38.768409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:38.769123 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:38.769591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:38.770008 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:38.904743 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:38.913068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5e5d128d-b653-4e97-a74a-91a351f28ceb tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.156673 Sep 01 05:46:38.913690 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 548/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:38 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:39.939729 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:39.940858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:39.952882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:39.953710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:39.954362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:39.955303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:39.955892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:39.956444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:40.181826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:40.190269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4049b09e-a72f-4397-96d4-901c1a6ab1e0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.258764 Sep 01 05:46:40.190882 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 530/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:39 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:41.212549 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:41.213251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:41.220219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:41.220696 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:41.221121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:41.221830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:41.222273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:41.222685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:41.354101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:41.362510 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-072c47cf-cce5-4e13-8a21-021682e57bf3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.154361 Sep 01 05:46:41.363112 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 549/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:41 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:42.383503 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:42.384105 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:42.391586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:42.392163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:42.392597 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:42.393291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:42.393764 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:42.394181 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:42.531746 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:42.539956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-be413d8c-03b4-4b85-be90-c0413f9f305a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.160266 Sep 01 05:46:42.540724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 531/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:42 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:43.562342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:43.563050 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:43.572210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:43.573860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:43.574753 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:43.576210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:43.577286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:43.578283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:43.821858 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:43.831350 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3059407-c198-4e05-90b4-52f6f42504e1 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.273134 Sep 01 05:46:43.831917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 550/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:43 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:44.853810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:44.854407 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:44.856705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:44.861686 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.862164 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.862586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.863266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.863703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.864220 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:45.016544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:45.024429 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4351efeb-b6cb-42b2-be8d-6ec598ec39e7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.174567 Sep 01 05:46:45.024999 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 532/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:44 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:46.046048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:46.046816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:46.049359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:46.054017 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:46.054491 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:46.054915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:46.055592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:46.056030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:46.056438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:46.202503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:46.210830 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c9feecbd-e528-4d95-bed3-0bff13cf6c1a tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.169423 Sep 01 05:46:46.213163 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 551/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:46 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:46.575265 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "name": "network-vif-plugged", "status": "completed", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:46.587208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:46.587626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:46.588058 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:46.601113 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] Creating event network-vif-plugged:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:46:46.606389 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-2aadc0b9-ae2b-442f-8d22-715089364bb3 req-017e3a80-e940-40f7-b859-d7c67b78b2e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035150 Sep 01 05:46:46.607238 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 533/1084] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:47.233477 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.234018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.240424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.240899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.241324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.242036 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.242481 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.242895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.375981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:47.383737 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ddf73599-825e-46ae-a5b1-ffd6c7b327b0 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.154825 Sep 01 05:46:47.384290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 552/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:47 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:48.405902 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:48.406588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:48.412724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:48.413199 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:48.413661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:48.414338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:48.414782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:48.415202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:48.548948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:48.556702 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ba7e23ad-6df5-4ef8-ab54-ac8cbc323a3d tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1575 microversion: 2.1 time: 0.155832 Sep 01 05:46:48.557282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 534/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:48 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:49.577992 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:49.578592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:49.584986 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:49.585475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:49.585909 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:49.586578 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:49.587015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:49.587423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:49.718404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:49.726334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3be42eb5-af51-4336-a359-e9bbcfa863d7 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1562 microversion: 2.1 time: 0.152703 Sep 01 05:46:49.726891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 553/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:49 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:57.295244 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:57.300462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:57.304138 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.304619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.305050 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.305766 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.306216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.306635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.337345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1a8196d5-c8ca-4c6f-be6e-f62e81aa3da4 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046015 Sep 01 05:46:57.337969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 535/1088] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 1 05:46:57 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:57.399973 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:57.400496 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:57.407282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.407763 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.408190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.408880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.409334 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.409787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.433981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:46:57.700756 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-605796ff-48c3-40f7-900e-bd937faa0055 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 204 len: 0 microversion: 2.20 time: 0.304289 Sep 01 05:46:57.701412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 554/1089] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 1 05:46:57 2022] DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 05:46:57.709727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:57.710315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:57.716693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.717170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.717637 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.718635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:57.719079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:57.719519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:57.851675 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:57.860375 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:57.861826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:57.862981 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3c91cf2a-3a43-4bad-ab82-48b95f95a75c tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.157199 Sep 01 05:46:57.863539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 536/1090] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:46:57 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:46:58.887427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:58.888158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:58.895409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:58.895881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:58.896300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:58.896974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:58.897468 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:58.897842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:58.916165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:59.034738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:59.042881 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:59.044298 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:59.045438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6628861c-e623-49f2-b42d-f7ac99d00c83 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.162352 Sep 01 05:46:59.046007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 555/1091] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:46:58 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:47:00.069086 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:00.069697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:00.076724 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:00.077203 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:00.077792 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:00.078723 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:00.079171 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:00.079588 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:00.474838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:00.483449 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:00.485426 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:00.487026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-21276ae9-d4a3-4eaf-beb5-b4cd5b7fa411 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1724 microversion: 2.20 time: 0.421849 Sep 01 05:47:00.487591 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 537/1092] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:00 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:47:01.178581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4160389-3d85-4389-9cd4-84b0440b1e4e", "name": "network-vif-deleted", "tag": "f8dbaf00-9f9a-4ce5-ba87-c5c83d998965"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:01.189303 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:01.192022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:01.193048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:01.206037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] Creating event network-vif-deleted:f8dbaf00-9f9a-4ce5-ba87-c5c83d998965 for instance d4160389-3d85-4389-9cd4-84b0440b1e4e on hv-cinder-85220 Sep 01 05:47:01.212151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0ed9dbca-6ede-45ea-9a61-43768f97c64f req-57d3b3f4-eaf7-4c59-b2ab-23d44b6f1389 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037394 Sep 01 05:47:01.213273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 556/1093] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:01.510473 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:01.511753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:01.518796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:01.519551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:01.519984 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:01.520678 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:01.521291 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:01.521970 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:01.592041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:01.601539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:01.603379 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:01.604899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b2742a80-4482-467c-b8dd-564807f6af6b tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1656 microversion: 2.20 time: 0.098526 Sep 01 05:47:01.605892 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 538/1094] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:01 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:47:02.629922 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:02.630616 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:02.636961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:02.648217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:02.648217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:02.648217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:02.648217 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:02.648633 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:02.672422 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:02.672905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:02.673333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:02.673807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lazy-loading 'fault' on Instance uuid d4160389-3d85-4389-9cd4-84b0440b1e4e {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:47:02.717088 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:02.726576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:02.728281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa49a620d0e42b0947215d200fa45a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459dd5f92ff94f8b81d1e7213e8e7170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:02.729441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4dce6ce4-92ff-4463-9c11-3dcaea453110 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 200 len: 1371 microversion: 2.20 time: 0.104459 Sep 01 05:47:02.730227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 557/1095] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:02 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:47:03.753082 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:03.753736 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:03.760162 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:03.760640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:03.761068 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:03.761779 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:03.762229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:03.762644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:03.775927 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e HTTP/1.1 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:47:03.777589 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:03.779395 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': 'd4160389-3d85-4389-9cd4-84b0440b1e4e'} Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:47:03.780619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:03.782347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:03.793889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:47:03.793889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ad79a39d-e01e-473f-8e19-e27d7cf69c00 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 404 len: 111 microversion: 2.20 time: 0.030577 Sep 01 05:47:03.793889 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 539/1096] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:03 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:47:03.794165 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b6cddbb9-6d29-4176-a14f-00c0a8443594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '.version_select at 0x7fbb6b8f7f70>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:03.907562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b6cddbb9-6d29-4176-a14f-00c0a8443594 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379937833" status: 204 len: 0 microversion: 2.20 time: 0.123147 Sep 01 05:47:03.908160 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 558/1097] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Sep 1 05:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379937833 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:47:05.955277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:05.955994 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:05.962568 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:05.963046 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:05.963475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:05.964158 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:05.964718 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:05.966154 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:05.970259 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=61 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:05.983807 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e HTTP/1.1 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:47:05.984849 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:05.986620 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': 'd4160389-3d85-4389-9cd4-84b0440b1e4e'} Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:47:05.987598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:05.989206 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:05.990760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:47:05.990760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-570572ef-8cae-47e2-bef0-ebca605cd114 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 404 len: 111 microversion: 2.20 time: 0.035830 Sep 01 05:47:05.990760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 540/1098] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 1 05:47:05 2022] DELETE /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:47:05.995801 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:05.996432 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: d4160389-3d85-4389-9cd4-84b0440b1e4e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:06.006015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:06.006492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:06.007022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:06.007841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:06.008289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:06.008725 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:06.022695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e HTTP/1.1 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:47:06.024326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:06.026100 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': 'd4160389-3d85-4389-9cd4-84b0440b1e4e'} Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:47:06.027128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. Sep 01 05:47:06.028703 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:06.030310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance d4160389-3d85-4389-9cd4-84b0440b1e4e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:47:06.030310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b026aa32-ff42-46de-aa8b-3fec69ad5fa6 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e" status: 404 len: 111 microversion: 2.20 time: 0.034531 Sep 01 05:47:06.030310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 559/1099] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:05 2022] GET /compute/v2.1/servers/d4160389-3d85-4389-9cd4-84b0440b1e4e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:47:07.280098 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:07.281380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:07.288465 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.288941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.289370 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.290090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.290565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.290982 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.307222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 HTTP/1.1 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:47:07.308748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.310474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '43ced258-af06-4363-8db0-0f5b110bd561'} Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:47:07.311451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.313303 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.315062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:47:07.315062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-92ecc516-566d-4d2c-827d-78ad3458d39f tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 404 len: 111 microversion: 2.20 time: 0.033991 Sep 01 05:47:07.315062 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 541/1100] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 1 05:47:07 2022] DELETE /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:47:07.318682 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:07.319282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] [instance: 43ced258-af06-4363-8db0-0f5b110bd561] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:07.325668 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.326137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.326563 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.327295 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.327733 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.328146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.341269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] HTTP exception thrown: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Request method failure captured: Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 HTTP/1.1 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEVWPsgkN9-ls3lg17qAIGW-rBXQZmhWpZ862jvNxwSmp8zTWzSJ0ctI5r3tfixzZXH3V-g919WEXVTUhZpRthUw0GDbiabGsc8_oTGE0Z6KOUrX9VLXkyWn8GLxQD2VlhuwkFBgwcT79TCS5mDBsL1YbSz4Ced385gY3En_UMHfaTU Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:47:07.343322 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_459dd5f92ff94f8b81d1e7213e8e7170", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/459dd5f92ff94f8b81d1e7213e8e7170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 459dd5f92ff94f8b81d1e7213e8e7170 Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1354687896 Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 1aa49a620d0e42b0947215d200fa45a1 Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1354687896-project Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.345273 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '43ced258-af06-4363-8db0-0f5b110bd561'} Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:47:07.346395 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. Sep 01 05:47:07.347914 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:47:07.349271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] Returning 404 to user: Instance 43ced258-af06-4363-8db0-0f5b110bd561 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:47:07.349271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-929bbd03-5019-4cf4-b377-12934a21ea94 tempest-AttachVolumeShelveTestJSON-1354687896 tempest-AttachVolumeShelveTestJSON-1354687896-project] 10.222.0.42 "GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561" status: 404 len: 111 microversion: 2.20 time: 0.029776 Sep 01 05:47:07.349271 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 560/1101] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 1 05:47:07 2022] GET /compute/v2.1/servers/43ced258-af06-4363-8db0-0f5b110bd561 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:48:33.549853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=19 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:33.550598 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:33.555838 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-471702121", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "networks": [{"uuid": "a10fa0b0-94a5-42b4-8b67-dd04e5489199"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:33.621860 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] validate_networks() for [('a10fa0b0-94a5-42b4-8b67-dd04e5489199', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:48:34.273212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:48:34.273671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:48:34.274142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:48:34.274545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:48:34.274949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:48:34.283728 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:34.284202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:34.284630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:34.285345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:34.285823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:34.286493 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:34.306959 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Getting quotas for project 2f22ba19901d489db974b2f09cee6e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:48:34.309991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Getting quotas for user 46ecccda1e7b49969b26c6414c9c490a and project 2f22ba19901d489db974b2f09cee6e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:48:34.321786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:48:34.324052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:48:34.455814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-bebed0ec-d0c0-4793-907b-730ddd58a1b8 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907662 Sep 01 05:48:34.456454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 542/1102] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:48:34.465530 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:34.466603 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=16 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:34.472581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-46fc831c-ae95-4ffa-9c19-6e0cd21b8c32 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:34.473276 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-46fc831c-ae95-4ffa-9c19-6e0cd21b8c32 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:34.528052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-46fc831c-ae95-4ffa-9c19-6e0cd21b8c32 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:34.534843 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-46fc831c-ae95-4ffa-9c19-6e0cd21b8c32 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1213 microversion: 2.1 time: 0.071392 Sep 01 05:48:34.536452 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 561/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:34 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:35.556292 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:35.556924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:35.563012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:35.563488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:35.563956 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:35.564676 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:35.565131 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:35.565574 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:35.628266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:35.636871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a8092c85-6898-4d95-84d1-b7303b4a8e93 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1217 microversion: 2.1 time: 0.085164 Sep 01 05:48:35.637740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 543/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:35 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:36.658738 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:36.659353 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:36.667594 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:36.668076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:36.668506 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:36.669203 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:36.669678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:36.670091 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:36.740457 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:36.748608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cd529c25-7320-4efd-8f1a-72448739bddd tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1273 microversion: 2.1 time: 0.093796 Sep 01 05:48:36.749488 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 562/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:36 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:37.770095 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:37.771448 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:37.778670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:37.779151 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:37.779630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:37.780324 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:37.780774 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:37.781189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:37.988912 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:37.996713 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d23099ee-ac53-4308-bc78-bc4262e5224b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.230780 Sep 01 05:48:37.997280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 544/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:37 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:38.532198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e973537-db50-47bb-9444-d43b0b3fdf65", "tag": "42eaafc2-702a-44e4-a04d-112b9bc0313f"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:38.542486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:38.542962 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:38.543384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:38.555859 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] Creating event network-changed:42eaafc2-702a-44e4-a04d-112b9bc0313f for instance 0e973537-db50-47bb-9444-d43b0b3fdf65 on hv-cinder-85220 Sep 01 05:48:38.561376 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-6aaf8134-7f62-4359-9745-6da6417544fb req-86657621-ed7f-4412-ba06-83616e57a4a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170327 Sep 01 05:48:38.562411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 563/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:39.017925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:39.018500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:39.025096 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:39.028545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:39.028545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:39.028545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:39.028545 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:39.029066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:39.155839 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:39.164378 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-65f967b4-e0bd-49bd-ac48-fa3887763fd5 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.150460 Sep 01 05:48:39.164950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 545/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:39 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:40.184934 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:40.185771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:40.192767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:40.193409 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:40.193893 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:40.194582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:40.195020 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:40.195695 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:40.326126 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:40.334639 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5243c85b-1ee7-480a-9a59-f7bbc2a4c017 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.153984 Sep 01 05:48:40.335191 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 564/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:40 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:41.355824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:41.356414 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:41.362979 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:41.363451 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:41.363877 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:41.365618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:41.366072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:41.366489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:41.576241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:41.584393 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c404a8cb-2918-40e9-8201-22d9492b8d0b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.232418 Sep 01 05:48:41.585076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 546/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:41 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:42.605610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:42.606221 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:42.612673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:42.613149 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:42.613600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:42.614796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:42.615340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:42.615877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:42.747692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:42.755413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-23dd1872-3f42-427b-9424-3c813ce28047 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.153765 Sep 01 05:48:42.755977 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 565/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:42 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:43.260480 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e973537-db50-47bb-9444-d43b0b3fdf65", "name": "network-vif-plugged", "status": "completed", "tag": "42eaafc2-702a-44e4-a04d-112b9bc0313f"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:43.269770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:43.270245 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:43.270720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:43.282116 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] Creating event network-vif-plugged:42eaafc2-702a-44e4-a04d-112b9bc0313f for instance 0e973537-db50-47bb-9444-d43b0b3fdf65 on hv-cinder-85220 Sep 01 05:48:43.287543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-bd87147e-6b50-4ac3-a975-c6911a582487 req-9c8027eb-38d5-4fd1-85ad-a7c3856a17b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092166 Sep 01 05:48:43.288237 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 547/1112] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:43.775716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:43.776335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:43.782820 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:43.783294 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:43.783718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:43.784394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:43.784836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:43.785246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:43.912693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:43.920359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a5af3965-b39b-4d1d-b9b6-8e165da7a6f6 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.148453 Sep 01 05:48:43.920919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 566/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:43 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:48:44.942183 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:44.943142 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:44.946879 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:44.947670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:44.951337 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:44.951814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:44.952241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:44.953073 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:44.954161 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:44.954584 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.053661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:45.055474 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:45.058810 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:45.062771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:45.067896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:45.067896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.067896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:45.067896 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:45.068593 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.099787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:48:45.130403 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:45.139528 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7fc13e43-e2d0-49e3-84c0-d2329bf77b95 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1313 microversion: 2.1 time: 0.201590 Sep 01 05:48:45.140108 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 548/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:44 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:45.158020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:45.167242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:45.167712 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:45.168135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.182013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] Creating event network-changed:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:48:45.187091 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-729ce4f2-72d0-4e25-b8d2-c491d6b44390 req-9513c865-141c-4f85-884b-ecb2e0a124a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Sep 01 05:48:45.187896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 549/1115] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:45.413831 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b73714e2-c44b-4fe6-b135-dffd0c3f6f0b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 204 len: 0 microversion: 2.1 time: 0.364002 Sep 01 05:48:45.414419 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 567/1116] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:48:45 2022] DELETE /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:48:45.424695 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:45.425933 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:45.434254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:45.439824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:45.439824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.439824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:45.439824 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:45.440201 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:45.628645 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:45.636805 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-84cad1e8-8784-400a-aa88-d50605367eb3 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.217645 Sep 01 05:48:45.637321 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 550/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:45 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:46.160834 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:46.161875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:46.168302 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:46.168777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:46.169197 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:46.169895 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:46.170336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:46.170745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:46.299159 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:46.307586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8a8e2c46-09d4-4026-8184-d8605ab84ced tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1496 microversion: 2.1 time: 0.151177 Sep 01 05:48:46.308145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 568/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:46 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:46.661135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:46.662054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:46.668304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:46.668791 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:46.669216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:46.669944 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:46.670388 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:46.670798 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:46.886525 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:46.894587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-ead61b7b-5663-4f1b-9607-5206431dee46 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1568 microversion: 2.1 time: 0.238265 Sep 01 05:48:46.895173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 551/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:46 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:47.103734 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:47.104229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:47.110198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.110669 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.111094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.111778 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.112220 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.112635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.137289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:48:47.378576 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f0d1cecd-6e3a-45d8-84f3-ff02c8d2f2c0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 204 len: 0 microversion: 2.1 time: 0.278379 Sep 01 05:48:47.379283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 569/1120] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:48:47 2022] DELETE /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:48:47.388189 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:47.388795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:47.394827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.395965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.396397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.397080 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.397539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.398092 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.616983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:47.625539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e5eca337-73a2-463f-b12d-c5bdfdb5dfcc tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1502 microversion: 2.1 time: 0.241289 Sep 01 05:48:47.626179 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 552/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:47 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:47.930323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:47.930323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:47.930323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.930323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.931260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.931260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.931260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.931260 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.933049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ded019-447f-4f29-9d3b-d147ee305975", "name": "network-vif-deleted", "tag": "44f07a74-dcc1-4440-8e72-c06a034d8edd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:47.942829 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:47.943297 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:47.943777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:47.954947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] Creating event network-vif-deleted:44f07a74-dcc1-4440-8e72-c06a034d8edd for instance d7ded019-447f-4f29-9d3b-d147ee305975 on hv-cinder-85220 Sep 01 05:48:47.960630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ac5b8db9-bd16-4bc3-85a4-ac7d79412472 req-f213f142-5a89-4e45-bd7c-941c40e89ed2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Sep 01 05:48:47.961240 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 553/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:48:47.995540 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:48.003499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aa1dd902-d5b5-4bdf-8908-051c10ea5d9b tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1382 microversion: 2.1 time: 0.090175 Sep 01 05:48:48.004061 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 570/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:47 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:48.648732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:48.649424 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:48.655751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:48.656223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:48.656651 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:48.657336 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:48.657826 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:48.658242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:48.797721 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:48.806072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-32afc992-7df1-40f2-94e5-64b21dbfc4e2 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1502 microversion: 2.1 time: 0.162205 Sep 01 05:48:48.806648 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 554/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:48 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:49.024582 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:49.025137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:49.031402 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:49.031874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:49.032297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:49.033025 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:49.033480 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:49.033886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:49.360763 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e1b0901d174b10b49709d74d5fe5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f37da900443bea3ab358845a7c773', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:49.369577 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c30925b7-6bde-46a9-bd25-b2d657eb5432 tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 200 len: 1220 microversion: 2.1 time: 0.349137 Sep 01 05:48:49.370404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 571/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:49 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 1220 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:49.828066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:49.828670 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:49.836486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:49.837147 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:49.837900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:49.838622 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:49.839075 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:49.839498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:49.906969 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:49.915006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-00452da6-d8c1-49c3-bd90-3a290ce5af47 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1460 microversion: 2.1 time: 0.091277 Sep 01 05:48:49.917650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 555/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:49 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1460 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:49.974615 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e973537-db50-47bb-9444-d43b0b3fdf65", "name": "network-vif-deleted", "tag": "42eaafc2-702a-44e4-a04d-112b9bc0313f"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:49.984049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:49.984517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:49.984938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:49.996502 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] Creating event network-vif-deleted:42eaafc2-702a-44e4-a04d-112b9bc0313f for instance 0e973537-db50-47bb-9444-d43b0b3fdf65 on hv-cinder-85220 Sep 01 05:48:50.001297 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0b88ae0c-5025-40ef-94a7-9f1e4b186f6b req-38e87e2d-1196-4980-a4cb-c1c1dc3bbac6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 Sep 01 05:48:50.001906 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 572/1127] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:48:50.391534 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:50.392132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] [instance: d7ded019-447f-4f29-9d3b-d147ee305975] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:50.398178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:50.398683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:50.399106 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:50.399775 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:50.400213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:50.400630 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:50.417242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] HTTP exception thrown: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Request method failure captured: Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 HTTP/1.1 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEZXsuKYYMM-OaZQnl_5ozUYljuhLX7eZXhJpvuJJiCEVnlYcEquVXkt9eMFZJ1LQDzxVQLCZABva0TPRFfcqpfj0pdmiJXL97RTp6Ewbk08fWNEav0ElSgPIJ36Pfx_Qt-ZwcGrZ3jqZkXch3Z6vqU3SXZ8Dov9r_40F8LZg6mowwo Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 138f37da900443bea3ab358845a7c773 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-TestShelveInstance-1640910571 Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:48:50.419017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138f37da900443bea3ab358845a7c773"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138f37da900443bea3ab358845a7c773", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138f37da900443bea3ab358845a7c773"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138f37da900443bea3ab358845a7c773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-TestShelveInstance-1640910571 Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 138f37da900443bea3ab358845a7c773 Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-TestShelveInstance-1640910571 Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-TestShelveInstance-1640910571-project Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 45e1b0901d174b10b49709d74d5fe5d6 Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-TestShelveInstance-1640910571-project Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. Sep 01 05:48:50.420910 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': 'd7ded019-447f-4f29-9d3b-d147ee305975'} Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:48:50.422232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. Sep 01 05:48:50.423940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:48:50.425671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Returning 404 to user: Instance d7ded019-447f-4f29-9d3b-d147ee305975 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:48:50.425671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-eb4dee95-5026-4480-ba75-cc8eb54ca73e tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975" status: 404 len: 111 microversion: 2.1 time: 0.032748 Sep 01 05:48:50.425671 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 556/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:50 2022] GET /compute/v2.1/servers/d7ded019-447f-4f29-9d3b-d147ee305975 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:48:50.670566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b798495-b010-4f01-8206-a5c084d53e0f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] Calling method '.version_select at 0x7fbb6b8f7f70>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:50.756275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b798495-b010-4f01-8206-a5c084d53e0f tempest-TestShelveInstance-1640910571 tempest-TestShelveInstance-1640910571-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1165489474" status: 202 len: 0 microversion: 2.1 time: 0.090364 Sep 01 05:48:50.756860 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 573/1129] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 1 05:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1165489474 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:48:50.936441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:50.937200 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:50.944277 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:50.944763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:50.945489 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:50.946404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:50.946858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:50.947397 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:50.981681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:50.982163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:50.982587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:50.983222 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lazy-loading 'fault' on Instance uuid 0e973537-db50-47bb-9444-d43b0b3fdf65 {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:48:51.025949 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:51.035262 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-cb194285-4bd5-4774-b92b-db072114d172 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 200 len: 1303 microversion: 2.1 time: 0.102798 Sep 01 05:48:51.044972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 557/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:50 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:52.057624 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:52.058232 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: 0e973537-db50-47bb-9444-d43b0b3fdf65] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:52.065037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:52.065532 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:52.065955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:52.066661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:52.067708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:52.068404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:52.085385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] HTTP exception thrown: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Request method failure captured: Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 HTTP/1.1 Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEevO0Aga33E7qDJnP33x9pifYUNUXTVPIrs1NW-rbDWMF_l9p2I0gutz8BFLNQc06YxjjZkKChW8chAtgi402WPyuqhCB8ci3ye85Idv4e1b-qsZyQ5fibXM6qSkxpKsCxuWAhv5eZkDBmoKV67VpXFCogOwQfQZVPNDqutRQkq27o Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 2f22ba19901d489db974b2f09cee6e0b Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesActionsTest-1176854784 Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:48:52.087048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2f22ba19901d489db974b2f09cee6e0b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesActionsTest-1176854784 Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 2f22ba19901d489db974b2f09cee6e0b Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesActionsTest-1176854784 Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesActionsTest-1176854784-project Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 46ecccda1e7b49969b26c6414c9c490a Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesActionsTest-1176854784-project Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. Sep 01 05:48:52.088805 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '0e973537-db50-47bb-9444-d43b0b3fdf65'} Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:48:52.090015 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. Sep 01 05:48:52.092062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:48:52.093394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Returning 404 to user: Instance 0e973537-db50-47bb-9444-d43b0b3fdf65 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:48:52.093394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-34688980-4729-4ddb-a597-d961b16667f1 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65" status: 404 len: 111 microversion: 2.1 time: 0.035360 Sep 01 05:48:52.093394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 574/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:52 2022] GET /compute/v2.1/servers/0e973537-db50-47bb-9444-d43b0b3fdf65 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:48:52.138808 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-635830068", "imageRef": "fffee635-3967-4862-b45b-1c306eaa2de5", "flavorRef": "452", "networks": [{"uuid": "a10fa0b0-94a5-42b4-8b67-dd04e5489199"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:52.192595 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] validate_networks() for [('a10fa0b0-94a5-42b4-8b67-dd04e5489199', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:48:52.558762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:48:52.559208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:48:52.559679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:48:52.560084 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:48:52.560486 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:48:52.579456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:52.579456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:52.579456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:52.579456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:52.579962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:52.579962 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:52.592331 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Getting quotas for project 2f22ba19901d489db974b2f09cee6e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:48:52.596640 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Getting quotas for user 46ecccda1e7b49969b26c6414c9c490a and project 2f22ba19901d489db974b2f09cee6e0b. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:48:52.609190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:48:52.611538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fffee635-3967-4862-b45b-1c306eaa2de5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:48:52.753311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2243f02c-6b32-4a9a-b5b2-e20aed9a4796 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618261 Sep 01 05:48:52.754705 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 558/1132] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:48:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:48:52.766873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4a6920b-03a7-499a-bfac-954ba81deeb3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:52.768141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c4a6920b-03a7-499a-bfac-954ba81deeb3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:52.878782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c4a6920b-03a7-499a-bfac-954ba81deeb3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:52.888146 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c4a6920b-03a7-499a-bfac-954ba81deeb3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1213 microversion: 2.1 time: 0.126588 Sep 01 05:48:52.888716 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 575/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:52 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:53.909787 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:53.911619 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:53.920748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:53.921650 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:53.922090 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:53.929442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:53.929442 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:53.939243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:53.998243 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:54.007384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-383afe44-fa4e-44c4-8314-6330cdd75c37 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1217 microversion: 2.1 time: 0.103049 Sep 01 05:48:54.007957 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 559/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:53 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:55.029053 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:55.030344 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:55.037921 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:55.038774 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:55.039136 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:55.040002 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:55.040740 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:55.041145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:55.138318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:55.147150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-744084ea-4981-4b5e-807d-078f85f06d80 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1273 microversion: 2.1 time: 0.122187 Sep 01 05:48:55.147852 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 576/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:55 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:56.168253 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:56.168875 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:56.175518 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:56.176586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:56.177216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:56.178047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:56.178498 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:56.178922 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:56.475035 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:56.483897 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3bbadcff-6ae1-4eef-9350-f31175c2b282 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.319635 Sep 01 05:48:56.484476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 560/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:56 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:57.511263 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:57.513388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:57.519856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:57.520588 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:57.521116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:57.521838 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:57.522289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:57.522705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:57.579660 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df88104c-bc5a-4567-9f75-9870ca0e65a2", "tag": "ed87020a-dd07-4cc6-970d-14ca2488e86c"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:57.594210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:57.594950 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:57.595693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:57.608111 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] Creating event network-changed:ed87020a-dd07-4cc6-970d-14ca2488e86c for instance df88104c-bc5a-4567-9f75-9870ca0e65a2 on hv-cinder-85220 Sep 01 05:48:57.614300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-3eb0cbbe-db7b-4d8c-8505-aecd71e9621f req-1c24ba89-0384-4458-8b95-9d43dfceb987 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048339 Sep 01 05:48:57.615172 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 561/1137] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:57.784397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:57.793331 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1e8c2c73-b9c4-4dce-a50d-d7ad6da38dc7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.285997 Sep 01 05:48:57.805950 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 577/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:57 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:58.816241 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:58.817055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:58.824658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:58.825077 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:58.825552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:58.826246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:58.826861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:58.827278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:58.971983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:58.976459 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=100 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:58.981356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-eab61ec7-da15-4824-87b8-d8e220327239 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.169245 Sep 01 05:48:58.982306 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 562/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:58 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:00.002078 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:00.002595 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:00.009665 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:00.010143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:00.010570 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:00.011252 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:00.011704 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:00.012119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:00.147816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:00.155752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3c42d5b1-8f8b-496a-bbb0-aa7eeed28fa9 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.157699 Sep 01 05:49:00.156306 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 578/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:59 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:01.176236 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:01.176843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:01.184544 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:01.185025 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:01.185481 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:01.186178 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:01.186688 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:01.187107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:01.334472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:01.342982 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a455b73c-60d1-48ae-bf0b-71a56445faf7 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.170531 Sep 01 05:49:01.343546 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 563/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:01 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:02.364418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:02.365213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:02.372209 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:02.372683 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:02.373105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:02.373815 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:02.374251 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:02.374661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:02.379048 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:02.506953 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:02.515128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4a3c198f-0a6c-4d2f-b963-4f5d13bf2815 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.154671 Sep 01 05:49:02.515755 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 579/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:02 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:03.538320 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:03.541567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:03.541567 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:03.542280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:03.547374 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:03.547846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:03.548483 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:03.549180 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:03.549652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:03.550249 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:03.709652 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:03.717972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-86ad2d27-cd92-4723-a86b-2520afafae9e tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.183474 Sep 01 05:49:03.718583 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 564/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:03 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:04.739212 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:04.740427 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:04.742286 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:04.747787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:04.748269 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:04.748699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:04.749388 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:04.749856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:04.751049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:04.902139 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:04.911016 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fa360507-69d8-49f7-8d3b-0c0584bfc837 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.175904 Sep 01 05:49:04.912645 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 580/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:04 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:05.364267 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df88104c-bc5a-4567-9f75-9870ca0e65a2", "name": "network-vif-plugged", "status": "completed", "tag": "ed87020a-dd07-4cc6-970d-14ca2488e86c"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:05.376349 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:05.378499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:05.379231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:05.379846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:05.394278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] Creating event network-vif-plugged:ed87020a-dd07-4cc6-970d-14ca2488e86c for instance df88104c-bc5a-4567-9f75-9870ca0e65a2 on hv-cinder-85220 Sep 01 05:49:05.400425 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-a9fda919-1086-4c2c-aa9d-367b0cab9aa2 req-1ee806be-1c4b-4a73-a945-c69937a9ec8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041692 Sep 01 05:49:05.401668 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 565/1145] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:05.932693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:05.933285 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:05.941796 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:05.953648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:05.953648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:05.953648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:05.953648 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:05.954423 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:06.139699 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:06.148876 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d35aa541-c9df-4816-9684-38ba8bc644e3 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.220096 Sep 01 05:49:06.149782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 581/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:05 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:07.170973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:07.171654 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:07.179254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:07.179731 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:07.180155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:07.180841 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:07.181282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:07.181722 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:07.314051 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:07.323136 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-4f90851b-6cd6-4cfb-8949-dde5370e357b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1313 microversion: 2.1 time: 0.156689 Sep 01 05:49:07.323633 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 566/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:07 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:08.345565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:08.346179 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:08.348874 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:08.355757 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:08.356180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:08.356988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:08.357721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:08.358348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:08.358771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:08.561939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:08.570612 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-320abbd1-914e-4ced-abfc-350c007b7b67 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1496 microversion: 2.1 time: 0.228731 Sep 01 05:49:08.571440 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 582/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:08 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1496 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:09.495846 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:09.496446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:09.502554 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:09.503041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:09.503460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:09.504357 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:09.504795 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:09.505810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:09.532435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Going to try to terminate instance {{(pid=121033) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:09.853896 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-700b15f9-e2c2-4a38-b95b-596435910c4b tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 204 len: 0 microversion: 2.1 time: 0.360757 Sep 01 05:49:09.861026 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 567/1149] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:09 2022] DELETE /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:09.868158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:09.868770 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:09.875939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:09.876515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:09.876942 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:09.877815 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:09.878439 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:09.879199 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:10.092359 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:10.102245 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2bee1cd7-02e7-49bf-b3e4-0af968fa0f38 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1502 microversion: 2.1 time: 0.242474 Sep 01 05:49:10.103691 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 583/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:09 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:11.125716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:11.127148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:11.140991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:11.141831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:11.142632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:11.143345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:11.143955 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:11.144536 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:11.352446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:11.374616 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9ae6c83d-f01f-4983-9a3b-aa9b43afc347 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1502 microversion: 2.1 time: 0.253826 Sep 01 05:49:11.378478 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 568/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:11 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:12.401511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:12.406342 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:12.412872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df88104c-bc5a-4567-9f75-9870ca0e65a2", "name": "network-vif-deleted", "tag": "ed87020a-dd07-4cc6-970d-14ca2488e86c"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:12.423600 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:12.425380 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:12.425837 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:12.426549 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:12.427589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:12.432128 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:12.432758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:12.433228 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:12.433679 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:12.462460 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] Creating event network-vif-deleted:ed87020a-dd07-4cc6-970d-14ca2488e86c for instance df88104c-bc5a-4567-9f75-9870ca0e65a2 on hv-cinder-85220 Sep 01 05:49:12.468283 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-ec62b128-e8b1-45c9-a63c-f50141a04d9f req-c5e6ef6e-712b-4ca6-a514-7dcc7d5f4e5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060750 Sep 01 05:49:12.469621 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 569/1152] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:49:12.557154 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ecccda1e7b49969b26c6414c9c490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f22ba19901d489db974b2f09cee6e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:12.566200 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aa323a7c-a5e1-4034-9ee8-1d5125777da0 tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 200 len: 1460 microversion: 2.1 time: 0.170285 Sep 01 05:49:12.581879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 584/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:12 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 1460 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:13.592522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:13.593344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] [instance: df88104c-bc5a-4567-9f75-9870ca0e65a2] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:13.605983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:13.608887 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:13.609666 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:13.610636 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:13.611953 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:13.612606 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:13.638811 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] HTTP exception thrown: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Request method failure captured: Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 HTTP/1.1 Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEevO0Aga33E7qDJnP33x9pifYUNUXTVPIrs1NW-rbDWMF_l9p2I0gutz8BFLNQc06YxjjZkKChW8chAtgi402WPyuqhCB8ci3ye85Idv4e1b-qsZyQ5fibXM6qSkxpKsCxuWAhv5eZkDBmoKV67VpXFCogOwQfQZVPNDqutRQkq27o Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 2f22ba19901d489db974b2f09cee6e0b Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-VolumesActionsTest-1176854784 Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:49:13.640469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2f22ba19901d489db974b2f09cee6e0b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f22ba19901d489db974b2f09cee6e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-VolumesActionsTest-1176854784 Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 2f22ba19901d489db974b2f09cee6e0b Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-VolumesActionsTest-1176854784 Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-VolumesActionsTest-1176854784-project Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 46ecccda1e7b49969b26c6414c9c490a Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-VolumesActionsTest-1176854784-project Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. Sep 01 05:49:13.642152 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': 'df88104c-bc5a-4567-9f75-9870ca0e65a2'} Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:13.643049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. Sep 01 05:49:13.644462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:49:13.651837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] Returning 404 to user: Instance df88104c-bc5a-4567-9f75-9870ca0e65a2 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:13.651837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-37ad1ad2-9f2d-4e18-aeb2-841a95d42e8f tempest-VolumesActionsTest-1176854784 tempest-VolumesActionsTest-1176854784-project] 10.222.0.42 "GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2" status: 404 len: 111 microversion: 2.1 time: 0.054217 Sep 01 05:49:13.651837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 570/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:13 2022] GET /compute/v2.1/servers/df88104c-bc5a-4567-9f75-9870ca0e65a2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:14.106458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7303245d-58d1-446b-b83f-c2b822e33536 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Action: 'create', calling method: .version_select at 0x7fbb6f27cee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1324821723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNcXt6QSxE6CHzNTZ8YoJi8yydRz2t4FHSUW53hU6YeytkhZIEfo7wT+kXCa0bBvjwg101ZxEHgHvw5Hw53aSVBXCGgaKO++SV0R8X1gISGO7m7AVI4ePFg5TaIYKfjQ=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:14.124996 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-7303245d-58d1-446b-b83f-c2b822e33536 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:49:14.129856 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-7303245d-58d1-446b-b83f-c2b822e33536 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for user 99c0ab8ddd164b44a22370a7cc1042be and project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:49:14.225982 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7303245d-58d1-446b-b83f-c2b822e33536 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.330185 Sep 01 05:49:14.233366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 585/1155] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 1 05:49:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:46.315677 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-657779440", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1324821723", "security_groups": [{"name": "tempest-secgroup-smoke-1636124748"}], "block_device_mapping_v2": [{"uuid": "d8b6c9c5-4867-421b-8afb-20496661c545", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "010f57c5-839a-417b-8e09-74417295453c"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:46.326694 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:46.327428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:46.440557 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] validate_networks() for [('010f57c5-839a-417b-8e09-74417295453c', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:49:46.821761 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:49:46.822428 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:49:46.826346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:49:46.826346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:49:46.826346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:49:46.832899 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.833375 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.833848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.834563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.835005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.835417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.852286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:49:46.856335 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for user 99c0ab8ddd164b44a22370a7cc1042be and project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:49:46.914759 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:49:46.917703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8b6c9c5-4867-421b-8afb-20496661c545',volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:49:47.266014 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-99184c75-c30e-4c57-9d39-3da7b894feb9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.954022 Sep 01 05:49:47.266853 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 571/1156] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:49:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:49:47.276049 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=34 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:47.281196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:47.281196 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:47.281676 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6a84bff9-7c4b-4e47-a564-2cb9f8f0ed72 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:47.282340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6a84bff9-7c4b-4e47-a564-2cb9f8f0ed72 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:47.341145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a84bff9-7c4b-4e47-a564-2cb9f8f0ed72 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:47.349246 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6a84bff9-7c4b-4e47-a564-2cb9f8f0ed72 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1094 microversion: 2.1 time: 0.075425 Sep 01 05:49:47.349842 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 586/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:47 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:48.372123 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:48.372720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:48.379753 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.380233 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.380661 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:48.381417 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.381897 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.382317 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:48.443624 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:48.452587 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-3e25a3c5-1a44-45eb-a096-f8f2bab02f9e tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1144 microversion: 2.1 time: 0.085084 Sep 01 05:49:48.453148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 572/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:48 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:49.474074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:49.474766 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:49.482458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.482918 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.483339 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.484030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.484470 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.484890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.579291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:49.587782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-13341c8c-6d73-400b-a15b-5a7acce1a0b0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1200 microversion: 2.1 time: 0.118316 Sep 01 05:49:49.588567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 587/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:49 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:50.609790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:50.610575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:50.617522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.618044 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.618569 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:50.619265 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.619703 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.620120 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.084720 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:51.092751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-db8a65c6-b6b1-4a15-b855-829df063dfe3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1278 microversion: 2.1 time: 0.487211 Sep 01 05:49:51.093309 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 573/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:50 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1278 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:51.525326 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d38db57-db6c-4601-9e1f-12fd7c7fcd8b", "tag": "3f196a26-52d2-4785-a1ad-ef8756640e82"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:51.535441 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.535943 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.536358 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.547999 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] Creating event network-changed:3f196a26-52d2-4785-a1ad-ef8756640e82 for instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b on hv-cinder-85220 Sep 01 05:49:51.553627 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-40672c05-7907-4b58-a21e-5fc129adb339 req-97a54102-fb70-4440-8c24-bd907e885efb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033690 Sep 01 05:49:51.554145 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 588/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:52.113390 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:52.114133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:52.120828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.121365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.121835 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.122529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.123049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.123474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.327216 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:52.334967 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c196beb7-a04b-4732-badd-8b722d990f38 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.225419 Sep 01 05:49:52.335535 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 574/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:52 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:53.357171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:53.357923 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:53.364489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.364957 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.365375 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.366067 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.366505 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.367575 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.499424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:53.507150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ee551185-89f5-4d1e-9418-a3b14f6a7562 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.154188 Sep 01 05:49:53.507736 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 589/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:53 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:49:54.527685 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:54.528266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:54.534717 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.535190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.535617 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.536294 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.536739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.537150 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.674931 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:54.683202 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e8bf58fa-69e5-4641-8037-436eb422dca4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.159496 Sep 01 05:49:54.683761 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 575/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:54 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:55.703681 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:55.704277 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:55.711629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.712118 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.712542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.713227 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.713701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.714115 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.847849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:55.856122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-da187db2-528b-4e01-bb56-d8e0c23b59f6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.156295 Sep 01 05:49:55.860003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 590/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:55 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:56.876488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:56.877085 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:56.879402 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:56.880850 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:56.885055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.885564 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.885991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.886665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.887107 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.887519 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:57.033634 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:57.042036 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7753ac6e-770d-4a4d-8894-9d2267b67669 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.169390 Sep 01 05:49:57.042607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 576/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:56 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:58.073993 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:58.074608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:58.080629 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.081103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.081591 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.082280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.082722 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.083137 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.213693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:58.221404 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-deaf92f7-6d41-48aa-a30e-f6a397f90749 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.152252 Sep 01 05:49:58.221990 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 591/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:58 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:59.242012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:59.242866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:59.249347 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:59.249848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:59.250269 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:59.250948 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:59.251385 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:59.251796 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:59.382563 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:59.390176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b31c397c-ab42-4773-9fd0-d4161f4adf30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.152234 Sep 01 05:49:59.390732 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 577/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:59 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:50:00.411207 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:00.411804 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:00.414919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:00.419718 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:00.420194 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:00.420621 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:00.421315 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:00.421771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:00.422190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:00.560248 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:00.567829 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-43d9d9c4-47fd-49e4-b73c-ff145dec334a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.160517 Sep 01 05:50:00.568398 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 592/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:00 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:01.588213 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:01.588871 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:01.595328 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.595801 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.596230 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.596900 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.597344 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.597785 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.730599 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:01.738295 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-1a0e102d-3cda-4350-9709-46c6c7e78265 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.154009 Sep 01 05:50:01.738973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 578/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:01 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:01.868844 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d38db57-db6c-4601-9e1f-12fd7c7fcd8b", "name": "network-vif-plugged", "status": "completed", "tag": "3f196a26-52d2-4785-a1ad-ef8756640e82"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:01.878684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.879155 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.879581 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.890833 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] Creating event network-vif-plugged:3f196a26-52d2-4785-a1ad-ef8756640e82 for instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b on hv-cinder-85220 Sep 01 05:50:01.895650 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d992905f-e206-42da-8e05-f56fa104c092 req-7eabdff8-ea5d-4a9c-8f39-226b913a0250 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Sep 01 05:50:01.896210 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 593/1171] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:02.759605 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.760210 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:02.766658 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:02.767190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:02.767639 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:02.768338 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:02.768786 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:02.769198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:02.907410 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:02.916449 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-d7e30fea-a83e-4643-ac97-ced0339400ef tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.160761 Sep 01 05:50:02.917028 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 579/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:03.938524 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:03.939278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:03.945811 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.946310 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.946741 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:03.947430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.947873 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.948290 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:04.082445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:04.090291 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f18b55e4-cfca-4d3f-88d2-ba42dfc35c2d tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1266 microversion: 2.1 time: 0.156564 Sep 01 05:50:04.090849 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 594/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:03 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:05.111173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:05.111782 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:05.119001 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.119479 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.119914 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.120596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.121042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.121474 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.255081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:05.263017 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b2925118-767d-4edc-9ff7-d7d41c5f7340 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1453 microversion: 2.1 time: 0.155798 Sep 01 05:50:05.263577 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 580/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:05 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:05.283178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:05.283783 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:05.291116 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.291587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.292007 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.292680 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.293118 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.293568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.423004 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:05.431059 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-109640d2-3ceb-45bf-a0ae-3e5de947d5b5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1453 microversion: 2.1 time: 0.151613 Sep 01 05:50:05.431613 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 595/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:05 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:07.504963 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d38db57-db6c-4601-9e1f-12fd7c7fcd8b", "tag": "3f196a26-52d2-4785-a1ad-ef8756640e82"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:07.515551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.516020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.516440 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.527750 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] Creating event network-changed:3f196a26-52d2-4785-a1ad-ef8756640e82 for instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b on hv-cinder-85220 Sep 01 05:50:07.532909 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-587e88e7-134c-44ca-bbb7-7844fba181c4 req-9128af04-1a94-4528-9208-b4d9bf3024d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031583 Sep 01 05:50:07.533529 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 581/1176] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:21.230241 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe6661b8-c4f3-42b2-8878-bc7a74e80433] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:52:21.231447 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:52:21.231675 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b (ip 10.222.0.42) !!! Sep 01 05:52:21.233063 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:52:21.233235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b (ip 10.222.0.42) !!! Sep 01 05:52:21.233954 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=22 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:21.234721 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=46 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:21.239406 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:21.241857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:21.249386 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:21.250013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:21.250436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:21.251111 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:21.251568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:21.252147 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:21.279316 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:52:21.526635 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a57ccb97-95f4-4526-8097-0b9a904a6b6a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 204 len: 0 microversion: 2.1 time: 0.298198 Sep 01 05:52:21.527143 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 596/1177] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:52:21 2022] DELETE /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:52:21.533543 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:52:21.534074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:52:21.534194 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b (ip 10.222.0.42) !!! Sep 01 05:52:21.535551 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:52:21.535697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b (ip 10.222.0.42) !!! Sep 01 05:52:21.537252 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:21.538032 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=58 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:21.543254 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:21.543941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:21.553319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:21.558700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:21.558700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:21.558700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:21.558700 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:21.559285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:21.834135 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:21.841907 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b8ba6eb2-cc2e-4f0d-8da3-8e4417cbf936 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1577 microversion: 2.1 time: 0.310249 Sep 01 05:52:21.842471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 582/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:21 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1577 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:22.863213 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:22.863939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:22.871497 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:22.871967 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:22.872393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:22.873074 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:22.873543 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:22.873958 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:22.879450 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe6661b8-c4f3-42b2-8878-bc7a74e80433] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 50780. Sep 01 05:52:23.073312 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:23.081280 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f0bc7c86-e81d-49b6-90c6-0935e02e3ac0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1577 microversion: 2.1 time: 0.222311 Sep 01 05:52:23.081870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 597/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:22 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:52:24.104369 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:24.104995 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:24.114132 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:24.114683 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:24.115119 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:24.115827 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:24.116273 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:24.116699 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:24.122458 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 50786. Sep 01 05:52:24.307450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:24.315353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-dc3c191d-2711-43d9-b5f2-060546887d89 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1577 microversion: 2.1 time: 0.214936 Sep 01 05:52:24.315925 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 583/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:24 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:24.573988 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d38db57-db6c-4601-9e1f-12fd7c7fcd8b", "name": "network-vif-deleted", "tag": "3f196a26-52d2-4785-a1ad-ef8756640e82"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:24.583951 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:24.587022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:24.587022 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:24.596005 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] Creating event network-vif-deleted:3f196a26-52d2-4785-a1ad-ef8756640e82 for instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b on hv-cinder-85220 Sep 01 05:52:24.601424 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0c0b4e8b-abe6-40de-a277-5d85c00308f8 req-341123b5-a3b9-4e8d-ad01-d4103f19b52a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Sep 01 05:52:24.605417 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 598/1181] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:25.337898 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:25.339134 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:25.345940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:25.346420 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:25.346847 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:25.347742 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:25.348193 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:25.348607 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:25.387311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:25.387749 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:25.388197 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:25.388625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.objects.instance [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lazy-loading 'fault' on Instance uuid 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b {{(pid=121033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:52:25.436272 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:25.450346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c930d1d2-5e8a-4c53-ba12-e6a945b93902 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 200 len: 1230 microversion: 2.1 time: 0.111453 Sep 01 05:52:25.450346 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 584/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:25 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:26.466335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:26.467034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:26.474204 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:26.474685 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:26.475123 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:26.475812 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:26.476262 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:26.476679 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:26.489930 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] HTTP exception thrown: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Request method failure captured: Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b HTTP/1.1 Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEfSfF8Gnc6zF584rJAIR7uZVFo3zcOYxSSdzO3Rm_dINV8nbyFvIv9lUErxyNaxlx33suE0F_kktpBOHxGmRIvUbDOOFscsRGf4AqGsYzqrnQ3wPeS9fvchTmSsFFK8uZYKCo8KoNU71QLpQ-FVtKSaB6GYUPU6d5iMUV3rmzMirJo Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:52:26.491565 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8929d2f4d729433bb807e9f0890c9b1f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-679369864 Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 99c0ab8ddd164b44a22370a7cc1042be Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:52:26.493449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '4d38db57-db6c-4601-9e1f-12fd7c7fcd8b'} Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:52:26.494453 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:52:26.495997 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:52:26.497438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Returning 404 to user: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:52:26.497438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5462b521-2fc7-4d68-b238-8ebb974f2e17 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 404 len: 111 microversion: 2.1 time: 0.030689 Sep 01 05:52:26.497438 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 599/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:26 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:52:26.590313 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-238130253", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1324821723", "security_groups": [{"name": "tempest-secgroup-smoke-1636124748"}], "block_device_mapping_v2": [{"uuid": "d8b6c9c5-4867-421b-8afb-20496661c545", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "010f57c5-839a-417b-8e09-74417295453c"}]}} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:26.702952 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.network.neutron [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] validate_networks() for [('010f57c5-839a-417b-8e09-74417295453c', None, None, None, None, None)] {{(pid=121033) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:52:27.071052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:52:27.071465 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image limits 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:52:27.071924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:52:27.072323 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image pref 0:0:0 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:52:27.072719 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.virt.hardware [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:52:27.081326 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:27.081823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:27.082246 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:27.082958 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:27.083625 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:27.084148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:27.100697 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:52:27.104856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.quota [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for user 99c0ab8ddd164b44a22370a7cc1042be and project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:52:27.167052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Going to run 1 instances... {{(pid=121033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:52:27.167052 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8b6c9c5-4867-421b-8afb-20496661c545',volume_size=None,volume_type=None)] {{(pid=121033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:52:27.575304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-44357636-7a85-4531-af26-a5d02d815eb7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.988787 Sep 01 05:52:27.575941 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 585/1184] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:52:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:52:27.587283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6c94699e-594c-4cc7-8ec9-a7b7471798ee tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:27.587879 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6c94699e-594c-4cc7-8ec9-a7b7471798ee tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:27.643499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6c94699e-594c-4cc7-8ec9-a7b7471798ee tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:27.651135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6c94699e-594c-4cc7-8ec9-a7b7471798ee tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1094 microversion: 2.1 time: 0.068365 Sep 01 05:52:27.651693 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 600/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:27 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:28.671777 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:28.672384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:28.680031 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:28.680444 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:28.680872 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:28.681582 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:28.682033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:28.682443 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:28.749977 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:28.758067 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-8e3bb250-b068-49f1-8a72-c9a7ec80cdda tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1144 microversion: 2.1 time: 0.090240 Sep 01 05:52:28.758656 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 586/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:28 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:52:29.784806 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:29.785492 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:29.794507 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:29.798518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:29.798518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:29.798518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:29.798518 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:29.799283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:29.860654 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:29.869347 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1b64d0c4-23d3-4238-b14a-e90bd8d636dc tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1210 microversion: 2.1 time: 0.095590 Sep 01 05:52:29.869938 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 601/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:29 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:30.890983 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:30.891613 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:30.898255 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:30.898737 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:30.899165 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:30.901008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:30.901537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:30.901972 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:31.133416 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:31.146991 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e20384d8-9c97-45fc-8c79-d0f04425a597 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1278 microversion: 2.1 time: 0.259791 Sep 01 05:52:31.147578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 587/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:30 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:52:31.343709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5425b203-5671-4fe8-b105-439efc7f93a9", "tag": "cc670d9e-b08d-4a41-b927-e8ce9d330738"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:31.353926 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:31.354393 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:31.354917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:31.366684 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] Creating event network-changed:cc670d9e-b08d-4a41-b927-e8ce9d330738 for instance 5425b203-5671-4fe8-b105-439efc7f93a9 on hv-cinder-85220 Sep 01 05:52:31.372382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-3208739a-2247-421b-ba18-0245fcd736a6 req-ce6a1d83-4b23-483d-9a87-f53d5fb69574 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033527 Sep 01 05:52:31.373119 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 602/1189] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:52:32.175074 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:32.175769 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:32.183319 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:32.183790 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:32.184211 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:32.184881 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:32.185318 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:32.185761 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:32.319475 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:32.328170 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-82b13c22-be29-4291-bad3-a894cde862c9 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.157033 Sep 01 05:52:32.328740 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 588/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:32 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:33.348870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:33.349587 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:33.356677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:33.357151 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:33.357603 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:33.358278 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:33.358719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:33.359132 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:33.493970 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:33.501768 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-115b156a-59c0-475a-85a8-38d99d935ba7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.157016 Sep 01 05:52:33.502323 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 603/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:33 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:34.524499 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:34.525125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:34.531561 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:34.532034 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:34.532459 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:34.533129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:34.533593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:34.534005 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:34.664665 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:34.672744 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-c41bc011-1c30-4035-85a9-2670fb5ef53b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.153528 Sep 01 05:52:34.673307 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 589/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:34 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:35.694436 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:35.695150 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:35.701655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:35.702201 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:35.702708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:35.703394 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:35.703836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:35.704249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:35.837567 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:35.845188 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-db313aeb-10f0-4741-8cf5-48ad8679b475 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.155478 Sep 01 05:52:35.845771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 604/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:35 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:36.865680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:36.866278 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:36.873229 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:36.873739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:36.874166 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:36.874842 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:36.875280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:36.875709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:37.005477 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:37.013472 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-aedca54b-2067-43a6-bf0e-e88cf1455785 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.151929 Sep 01 05:52:37.014047 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 590/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:36 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:38.034767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:38.038304 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:38.038458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:38.043182 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:38.043655 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:38.044114 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:38.044792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:38.045238 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:38.045688 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:38.181016 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:38.188862 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-00e3f74e-1c76-4309-a2aa-0d027bb9f977 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.157981 Sep 01 05:52:38.194130 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 605/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:38 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:39.210913 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:39.211539 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:39.213368 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:39.214049 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=6 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:39.219285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:39.219762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:39.220192 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:39.220874 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:39.221315 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:39.221781 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:39.355054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:39.362710 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7ac6d17b-c7bd-4eab-ba19-6c96b6055a66 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.156290 Sep 01 05:52:39.364287 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 591/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:39 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:40.384187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:40.384792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:40.391250 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:40.391728 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:40.392158 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:40.392841 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:40.393287 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:40.393727 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:40.527356 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:40.535301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aef971ae-4b5e-4bbe-a582-f6052d95f782 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.155596 Sep 01 05:52:40.535875 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 606/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:40 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:41.556473 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:41.557079 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:41.564526 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:41.565013 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:41.565446 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:41.566177 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:41.566626 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:41.567046 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:41.703064 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:41.711894 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-a020be65-9750-45f4-9121-a5a579e86060 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.159942 Sep 01 05:52:41.712456 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 592/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:41 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:42.732103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:42.732701 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:42.739162 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:42.739631 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:42.740052 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:42.741035 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:42.741511 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:42.741932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:42.874013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:42.882610 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c8c83c45-74c4-45ce-b630-bec986c91bd6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.154139 Sep 01 05:52:42.883103 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 607/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:42 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:43.985538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:43.985538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:43.985538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:43.985538 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:43.986540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:43.986540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:43.986540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:43.986540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:44.051102 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:44.059693 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b6b04e8b-b244-4861-8720-f65e67510228 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.159868 Sep 01 05:52:44.060261 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 593/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:43 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:52:44.581840 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5425b203-5671-4fe8-b105-439efc7f93a9", "name": "network-vif-plugged", "status": "completed", "tag": "cc670d9e-b08d-4a41-b927-e8ce9d330738"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:44.592244 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:44.592702 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:44.593118 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:44.604335 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] Creating event network-vif-plugged:cc670d9e-b08d-4a41-b927-e8ce9d330738 for instance 5425b203-5671-4fe8-b105-439efc7f93a9 on hv-cinder-85220 Sep 01 05:52:44.609769 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-31ce029e-8e93-42e9-b636-306ad51def58 req-3f21f008-5789-4286-b9a6-a495d9f79005 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Sep 01 05:52:44.610332 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 608/1201] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:45.080942 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:45.081586 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:45.088040 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:45.088533 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:45.088966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:45.089680 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:45.090129 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:45.090549 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:45.219434 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:45.228042 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-74cf0761-fae5-4343-8e0d-2756bcebf1d5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.150940 Sep 01 05:52:45.228611 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 594/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:45 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:46.249421 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:46.250056 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:46.257711 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:46.258187 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:46.258642 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:46.259324 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:46.259767 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:46.260180 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:46.391687 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:46.400122 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c36e9fed-482b-46ec-9355-91100745dca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1266 microversion: 2.1 time: 0.154967 Sep 01 05:52:46.400692 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 609/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:46 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:52:47.420304 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:47.420905 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:47.427355 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.427851 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.428441 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.429125 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.429594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.430007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.560055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:47.567833 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f3a6d4fa-c47b-4517-bcd7-c792a4d1770c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1453 microversion: 2.1 time: 0.151471 Sep 01 05:52:47.568768 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 595/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:47 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:47.588224 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:47.590178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:47.595202 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.595678 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.596107 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.596780 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.597223 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.597660 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.734138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:47.741891 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a666f333-0b72-478c-abb4-0e3d54838911 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1453 microversion: 2.1 time: 0.158064 Sep 01 05:52:47.742451 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 610/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:47 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:49.856799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5425b203-5671-4fe8-b105-439efc7f93a9", "tag": "cc670d9e-b08d-4a41-b927-e8ce9d330738"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:49.867285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:49.867755 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:49.868173 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:49.879290 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] Creating event network-changed:cc670d9e-b08d-4a41-b927-e8ce9d330738 for instance 5425b203-5671-4fe8-b105-439efc7f93a9 on hv-cinder-85220 Sep 01 05:52:49.885566 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-bb394419-a811-4dbd-ab37-8491bdd712f1 req-f8ff6184-8eb2-4b31-8667-43f71758096d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032300 Sep 01 05:52:49.886148 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 596/1206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:51.753974 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:51.754715 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:51.760259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1550969162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1324821723", "security_groups": [{"name": "tempest-secgroup-smoke-1636124748"}], "block_device_mapping_v2": [{"uuid": "657472f8-3532-4102-b823-03ae1cd49414", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "010f57c5-839a-417b-8e09-74417295453c"}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:51.873908 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] validate_networks() for [('010f57c5-839a-417b-8e09-74417295453c', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:54:52.298592 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:54:52.299009 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:54:52.299475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:54:52.299872 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:54:52.300275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:54:52.310428 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:52.310899 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:52.311318 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:52.312034 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:52.312475 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:52.312886 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:52.330348 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:54:52.334283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Getting quotas for user 99c0ab8ddd164b44a22370a7cc1042be and project 8929d2f4d729433bb807e9f0890c9b1f. Resources: {'instances', 'ram', 'cores'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:54:52.390489 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:54:52.392603 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='657472f8-3532-4102-b823-03ae1cd49414',volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:54:52.808846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a47d6668-a152-4518-bded-09f28ea589a6 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.056599 Sep 01 05:54:52.809568 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 611/1207] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 1 05:54:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:54:52.820751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 05:54:52.821380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:52.823054 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=84 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:52.823997 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:54:52.824141 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 (ip 10.222.0.42) !!! Sep 01 05:54:52.833330 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-22eaf719-df23-4b0c-bb25-0cafe9ac0409 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:52.834641 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-22eaf719-df23-4b0c-bb25-0cafe9ac0409 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:52.897928 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-22eaf719-df23-4b0c-bb25-0cafe9ac0409 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:52.906471 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-22eaf719-df23-4b0c-bb25-0cafe9ac0409 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1095 microversion: 2.1 time: 0.089797 Sep 01 05:54:52.910384 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 597/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:52 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:53.927177 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:53.927807 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:53.934458 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:53.934981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:53.935411 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:53.936101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:53.936545 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:53.937111 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:54.000818 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:54.008370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-edc14f76-d9aa-48b2-a2e9-12871d875a83 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1145 microversion: 2.1 time: 0.085633 Sep 01 05:54:54.008961 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 612/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:53 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:55.029704 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:55.030438 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:55.046012 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 50974. Sep 01 05:54:55.048573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.049051 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.049618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.050231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.050663 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.051081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.134224 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:55.143070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-26b7c148-8179-460e-963e-040e715d0989 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1211 microversion: 2.1 time: 0.117857 Sep 01 05:54:55.143812 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 598/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:55 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:56.166915 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:56.167814 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:56.174782 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:56.175283 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:56.175737 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:56.176449 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:56.176888 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:56.177301 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:56.394792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:56.402430 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3565ac02-50b9-4961-8b89-3ac6769452ac tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1279 microversion: 2.1 time: 0.239536 Sep 01 05:54:56.403156 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 613/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:56 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:56.687356 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119", "tag": "e3e4914b-4b54-4e6e-81ca-04f2788113cd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:56.698702 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:56.730765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:56.730765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:56.730765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] Creating event network-changed:e3e4914b-4b54-4e6e-81ca-04f2788113cd for instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 on hv-cinder-85220 Sep 01 05:54:56.730765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-584be87e-5835-4089-aaa6-f9503ebed496 req-d4220319-5847-460e-b87c-770c1717ed09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101809 Sep 01 05:54:56.730765 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 599/1212] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:57.423176 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:57.423745 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:57.430198 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:57.430608 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:57.431027 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:57.431705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:57.432141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:57.432551 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:57.613672 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:57.621955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-62c19444-d7b3-4221-a749-4dfc8d5d446b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.202754 Sep 01 05:54:57.622523 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 614/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:57 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:58.643987 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:58.644672 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:58.650937 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:58.651419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:58.651843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:58.652522 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:58.652965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:58.653377 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:58.783286 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:58.790578 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-abe0a6b1-f996-4192-bcec-a7d4b184ea98 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.151390 Sep 01 05:54:58.791145 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 600/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:58 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:59.811542 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.812258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.819030 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.819503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.819927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.820602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.821046 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.821484 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.954673 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:59.962413 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f063726d-c61a-4bc2-8af5-666865741ca3 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.154825 Sep 01 05:54:59.962966 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 615/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:59 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:00.983690 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:00.984271 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:00.990575 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:00.991051 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:00.991476 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:00.992153 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:00.992594 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:00.993008 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:01.129643 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:01.138593 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-f2a376be-95f6-4784-a152-e21541cf23f2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.159254 Sep 01 05:55:01.139155 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 601/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:00 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:02.159486 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:02.160075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:02.166851 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:02.167382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:02.167869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:02.168557 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:02.169003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:02.169420 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:02.310890 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:02.318832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3382f061-8ecd-4868-a0cd-c39c2d85bc9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.163457 Sep 01 05:55:02.319384 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 616/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:02 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:03.339762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:03.340373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:03.342836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell0:SELECT=2 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:03.347618 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:03.348093 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:03.348520 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:03.349198 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:03.349676 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:03.350088 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:03.481675 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:03.489409 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b4b57aa1-fef1-4eac-aafc-4cd1c8b7d80c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.153563 Sep 01 05:55:03.490002 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 602/1218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:03 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:04.510300 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:04.510901 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:04.512705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:04.513362 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:04.518554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:04.521517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:04.521517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:04.521517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:04.521517 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:04.521939 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:04.650759 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:04.658980 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-af3bfdbc-be59-47ba-9ae9-de0761e90b81 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.152638 Sep 01 05:55:04.659554 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 617/1219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:04 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:05.679855 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:05.683081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:05.687698 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:05.688176 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:05.688709 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:05.689399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:05.691873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:05.692314 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:05.840537 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:05.848800 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-7f84bfa9-e553-476b-8dcb-1b48c32a16e4 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.172685 Sep 01 05:55:05.849399 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 603/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:05 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:06.868636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:06.869235 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:06.876336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:06.876808 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:06.877229 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:06.877940 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:06.878382 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:06.878794 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:07.010037 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:07.018368 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6d7aea04-4079-482c-a83a-e0a15ac0afff tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.153585 Sep 01 05:55:07.018932 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 618/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:06 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:08.039727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:08.040345 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:08.047022 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:08.047500 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:08.047929 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:08.048604 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:08.049041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:08.049450 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:08.180863 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:08.188727 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-e4a7d3c4-c767-4449-becc-e01d53fbbad2 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.153023 Sep 01 05:55:08.189300 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 604/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:08 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:09.209385 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:09.211719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:09.216705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:09.217186 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:09.217638 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:09.218330 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:09.218771 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:09.219183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:09.398454 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119", "name": "network-vif-plugged", "status": "completed", "tag": "e3e4914b-4b54-4e6e-81ca-04f2788113cd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:09.408540 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:09.409110 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:09.409635 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:09.425020 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] Creating event network-vif-plugged:e3e4914b-4b54-4e6e-81ca-04f2788113cd for instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 on hv-cinder-85220 Sep 01 05:55:09.430823 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-6992ad1f-ab1e-49bf-8359-289c63bceedb req-33944509-ecf1-4bdd-8f8e-145c91ed6ecd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093313 Sep 01 05:55:09.431802 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 605/1223] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:55:09.443719 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:09.451857 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-109b380f-75a8-4617-9e32-01f4933ee396 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.246365 Sep 01 05:55:09.452433 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 619/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:09 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:10.473076 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:10.473784 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:10.480890 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:10.481363 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:10.481818 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:10.482488 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:10.482926 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:10.483334 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:10.612858 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:10.620573 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-362dd453-1d4b-4b28-b8d1-22f81721ca0b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.151653 Sep 01 05:55:10.621130 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 606/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:10 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:11.640846 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:11.641445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:11.647917 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:11.651537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:11.651537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:11.651537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:11.651537 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:11.652003 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:11.786602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:11.794636 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b445f14e-ec7c-41ad-a8d5-9f82f2feb754 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1267 microversion: 2.1 time: 0.157597 Sep 01 05:55:11.801327 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 620/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:11 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:12.816242 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:12.816837 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:12.823916 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.824381 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.824799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.825494 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.825934 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.826341 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.958169 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:12.966631 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-52823c30-fd29-4b6b-bed0-c5b006de5c30 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1455 microversion: 2.1 time: 0.154574 Sep 01 05:55:12.967285 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 607/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:12 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:12.986515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:12.987171 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:12.993625 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.994094 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.994515 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.995478 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.995927 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.996340 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:13.124343 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:13.132028 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-34a320a3-ee20-456f-834d-84701d107187 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1455 microversion: 2.1 time: 0.149363 Sep 01 05:55:13.132589 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 621/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:12 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:15.150762 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119", "tag": "e3e4914b-4b54-4e6e-81ca-04f2788113cd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:15.161231 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:15.161739 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:15.162163 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:15.175041 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] Creating event network-changed:e3e4914b-4b54-4e6e-81ca-04f2788113cd for instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 on hv-cinder-85220 Sep 01 05:55:15.178453 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-2986db3d-7ca2-433d-970b-50156247c4ee req-22e7f584-6648-4e67-ab94-28a4bd4994e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Sep 01 05:55:15.179033 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 608/1229] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:04.985832 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:04.987101 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=62 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:04.988167 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:57:04.988306 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 (ip 10.222.0.42) !!! Sep 01 05:57:04.989295 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:57:04.989412 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 (ip 10.222.0.42) !!! Sep 01 05:57:04.989770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 05:57:04.992208 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_api:SELECT=26 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:04.993226 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG dbcounter [-] [121033] Writing DB stats nova_cell1:SELECT=54 {{(pid=121033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:04.994070 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:57:04.994191 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Thu Sep 1 05:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 01 05:57:04.997445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:04.997445 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:05.004880 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:05.005365 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:05.005816 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:05.006586 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:05.007178 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:05.007599 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:05.039366 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:57:05.074100 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119", "tag": "e3e4914b-4b54-4e6e-81ca-04f2788113cd"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:05.084814 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:05.085365 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:05.085873 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:05.097137 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] Creating event network-changed:e3e4914b-4b54-4e6e-81ca-04f2788113cd for instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 on hv-cinder-85220 Sep 01 05:57:05.106565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-a876caa8-c6b8-4dde-ac6b-3c1893c79a3e req-3dc2e75f-6c95-4ea4-8fe5-29e81100448f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115770 Sep 01 05:57:05.106565 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 609/1230] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:05.343823 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7fe198dc-de62-4392-96bc-8f0f521bcdc0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 204 len: 0 microversion: 2.1 time: 0.359630 Sep 01 05:57:05.348023 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 622/1231] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:57:04 2022] DELETE /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:57:05.354325 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:05.355066 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:05.362361 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:05.362856 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:05.363293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:05.364007 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:05.364462 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:05.364880 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:05.548918 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:05.556646 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-2540e99b-777d-454b-b0ea-ecd0a5b24ea5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1579 microversion: 2.1 time: 0.207330 Sep 01 05:57:05.557212 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 610/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:05 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:57:06.579243 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:06.579952 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:06.586405 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:06.586892 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:06.587325 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:06.588012 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:06.588460 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:06.588877 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:06.809562 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:06.817623 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a976e31a-af03-4168-a18a-4b1af20e10a7 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1579 microversion: 2.1 time: 0.242817 Sep 01 05:57:06.818183 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 623/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:06 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1579 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:07.840691 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:07.841282 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:07.855758 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b96281d-b3d5-48e6-8d15-f53d4202e1e3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 51076. Sep 01 05:57:07.857312 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:07.857836 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:07.858270 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:07.858966 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:07.859412 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:07.859828 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:07.866709 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119", "name": "network-vif-deleted", "tag": "e3e4914b-4b54-4e6e-81ca-04f2788113cd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:07.879121 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:07.879861 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:07.880282 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:07.893013 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] Creating event network-vif-deleted:e3e4914b-4b54-4e6e-81ca-04f2788113cd for instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 on hv-cinder-85220 Sep 01 05:57:07.898281 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d2260331-14d3-4512-b96d-c1235d1110d7 req-287cf0fc-2ec2-488c-b2bc-f9fa008e8b49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035505 Sep 01 05:57:07.898905 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 624/1234] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:07.928596 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:07.936821 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-9a63216e-15a7-40b1-ae23-5f49c3aa03dd tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1393 microversion: 2.1 time: 0.100952 Sep 01 05:57:07.937445 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 611/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:07 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1393 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:08.960129 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:08.960819 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:08.967661 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:08.968140 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:08.968566 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:08.969249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:08.969720 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:08.970138 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:09.001824 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:09.002221 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:09.002644 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:09.003076 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lazy-loading 'fault' on Instance uuid 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:09.048418 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:09.056219 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0fb2c24e-01ee-416d-b41f-220ca47d1d9b tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 200 len: 1231 microversion: 2.1 time: 0.100852 Sep 01 05:57:09.056777 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 625/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:08 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:10.076266 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:10.076866 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:10.083380 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:10.083854 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:10.084280 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:10.084960 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:10.085404 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:10.085848 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:10.099552 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] HTTP exception thrown: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Request method failure captured: Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 HTTP/1.1 Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEfSfF8Gnc6zF584rJAIR7uZVFo3zcOYxSSdzO3Rm_dINV8nbyFvIv9lUErxyNaxlx33suE0F_kktpBOHxGmRIvUbDOOFscsRGf4AqGsYzqrnQ3wPeS9fvchTmSsFFK8uZYKCo8KoNU71QLpQ-FVtKSaB6GYUPU6d5iMUV3rmzMirJo Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:57:10.101167 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8929d2f4d729433bb807e9f0890c9b1f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 99c0ab8ddd164b44a22370a7cc1042be Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. Sep 01 05:57:10.102985 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119'} Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:10.104223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. Sep 01 05:57:10.106924 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:10.108469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Returning 404 to user: Instance 7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:10.108469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-68650883-423f-40ca-b6e1-6394b54f85b1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119" status: 404 len: 111 microversion: 2.1 time: 0.030381 Sep 01 05:57:10.108469 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 612/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:10 2022] GET /compute/v2.1/servers/7b3eb0b1-6fc3-436a-bdc4-9e98f9d99119 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:13.532485 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:13.533705 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:13.534293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5425b203-5671-4fe8-b105-439efc7f93a9", "tag": "cc670d9e-b08d-4a41-b927-e8ce9d330738"}]} {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:13.540124 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:13.540624 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:13.541214 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:13.541929 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:13.542370 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:13.543490 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:13.543943 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:13.544419 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:13.544843 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:13.559485 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.compute.server_external_events [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] Creating event network-changed:cc670d9e-b08d-4a41-b927-e8ce9d330738 for instance 5425b203-5671-4fe8-b105-439efc7f93a9 on hv-cinder-85220 Sep 01 05:57:13.566055 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [req-963ae225-6ccd-493c-8ed8-d66c7adc0ca4 req-c871c9d4-b813-43fe-95cf-7013e0ae8dfd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034987 Sep 01 05:57:13.566644 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 613/1238] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:57:13.570135 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:57:13.863277 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cc7fbaa3-28f3-4a00-8673-dcb06ae7e24c tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 204 len: 0 microversion: 2.1 time: 0.334644 Sep 01 05:57:13.864190 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 626/1239] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:57:13 2022] DELETE /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:57:13.872965 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:13.876072 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:13.880133 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:13.880681 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:13.881215 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:13.882006 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:13.882531 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:13.883015 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:14.022322 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:14.031223 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-88259719-e107-4218-86e9-6426e60d7e5a tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1578 microversion: 2.1 time: 0.162508 Sep 01 05:57:14.031799 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 614/1240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:13 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:15.052787 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:15.053499 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:15.060105 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:15.060584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:15.061018 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:15.061730 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:15.062173 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:15.062981 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:15.244071 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:15.252602 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-265e5b07-020a-408e-8729-1af4ff87c225 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1578 microversion: 2.1 time: 0.204060 Sep 01 05:57:15.253169 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 627/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:15 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:16.273358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:16.274612 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:16.282954 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:16.283435 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:16.283861 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:16.284751 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:16.285382 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:16.285831 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:16.295669 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5425b203-5671-4fe8-b105-439efc7f93a9", "name": "network-vif-deleted", "tag": "cc670d9e-b08d-4a41-b927-e8ce9d330738"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:16.305333 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:16.305836 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:16.306259 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:16.317752 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] Creating event network-vif-deleted:cc670d9e-b08d-4a41-b927-e8ce9d330738 for instance 5425b203-5671-4fe8-b105-439efc7f93a9 on hv-cinder-85220 Sep 01 05:57:16.322983 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-b25fe2d4-83f7-4cc1-be56-9b28a2a11d45 req-7af3c1fd-8143-47fa-9031-ef38354785fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Sep 01 05:57:16.323584 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 628/1242] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:57:16.354692 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.policy [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121033) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:16.363358 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-759a16f8-fa18-481b-a34e-2fbd47336bd1 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1391 microversion: 2.1 time: 0.093878 Sep 01 05:57:16.364973 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 615/1243] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:16 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:17.385072 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:17.385789 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:17.392320 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:17.392792 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:17.393249 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:17.393955 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:17.394392 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:17.399336 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:17.426826 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:17.427289 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:17.427708 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:17.428141 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lazy-loading 'fault' on Instance uuid 5425b203-5671-4fe8-b105-439efc7f93a9 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:17.473847 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c0ab8ddd164b44a22370a7cc1042be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8929d2f4d729433bb807e9f0890c9b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:17.480528 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-abc018cf-2db1-4b7f-b87c-a4bf02b49219 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 200 len: 1230 microversion: 2.1 time: 0.099500 Sep 01 05:57:17.481442 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 629/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:17 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:18.502038 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:18.502632 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 5425b203-5671-4fe8-b105-439efc7f93a9] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:18.509169 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:18.509690 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:18.510127 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:18.510810 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:18.511770 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:18.512190 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:18.525528 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] HTTP exception thrown: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Request method failure captured: Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 HTTP/1.1 Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEfSfF8Gnc6zF584rJAIR7uZVFo3zcOYxSSdzO3Rm_dINV8nbyFvIv9lUErxyNaxlx33suE0F_kktpBOHxGmRIvUbDOOFscsRGf4AqGsYzqrnQ3wPeS9fvchTmSsFFK8uZYKCo8KoNU71QLpQ-FVtKSaB6GYUPU6d5iMUV3rmzMirJo Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:57:18.527767 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8929d2f4d729433bb807e9f0890c9b1f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 99c0ab8ddd164b44a22370a7cc1042be Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. Sep 01 05:57:18.529298 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '5425b203-5671-4fe8-b105-439efc7f93a9'} Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:18.530232 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. Sep 01 05:57:18.531628 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:18.532947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Returning 404 to user: Instance 5425b203-5671-4fe8-b105-439efc7f93a9 could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:18.532947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-b737cca2-ce57-482c-90f0-820b49556495 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9" status: 404 len: 111 microversion: 2.1 time: 0.031090 Sep 01 05:57:18.532947 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 616/1245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:18 2022] GET /compute/v2.1/servers/5425b203-5671-4fe8-b105-439efc7f93a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:19.029258 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:19.029919 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:19.036401 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.036870 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.037292 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.038062 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.038503 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.038912 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.052397 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] HTTP exception thrown: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Request method failure captured: Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b HTTP/1.1 Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Host: 10.222.0.42 Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEfSfF8Gnc6zF584rJAIR7uZVFo3zcOYxSSdzO3Rm_dINV8nbyFvIv9lUErxyNaxlx33suE0F_kktpBOHxGmRIvUbDOOFscsRGf4AqGsYzqrnQ3wPeS9fvchTmSsFFK8uZYKCo8KoNU71QLpQ-FVtKSaB6GYUPU6d5iMUV3rmzMirJo Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:57:19.054043 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8929d2f4d729433bb807e9f0890c9b1f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Id: 99c0ab8ddd164b44a22370a7cc1042be Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: exception: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.055869 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: action_args: {'id': '4d38db57-db6c-4601-9e1f-12fd7c7fcd8b'} Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:19.057068 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.059391 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.061075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Returning 404 to user: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:19.061075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8532e693-8111-442a-805a-04f228694509 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 404 len: 111 microversion: 2.1 time: 0.030172 Sep 01 05:57:19.061075 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 630/1246] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 1 05:57:19 2022] DELETE /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:19.064748 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '>' {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:19.065353 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.compute.api [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] [instance: 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b] Fetching instance by UUID {{(pid=121033) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:19.071293 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.071760 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.072182 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.072854 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Acquiring lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.073311 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.073940 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG oslo_concurrency.lockutils [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Lock "291d5233-e21e-4cca-8c5b-c73b810bd8f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.087281 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.wsgi [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] HTTP exception thrown: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Request method failure captured: Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: request: GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b HTTP/1.1 Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept: application/json Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Accept-Encoding: identity Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Connection: close Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Length: 0 Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Content-Type: application/json Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Host: 10.222.0.42 Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: Openstack-System-Scope: None Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Auth-Token: gAAAAABjEEfSfF8Gnc6zF584rJAIR7uZVFo3zcOYxSSdzO3Rm_dINV8nbyFvIv9lUErxyNaxlx33suE0F_kktpBOHxGmRIvUbDOOFscsRGf4AqGsYzqrnQ3wPeS9fvchTmSsFFK8uZYKCo8KoNU71QLpQ-FVtKSaB6GYUPU6d5iMUV3rmzMirJo Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Id: None Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Domain-Name: None Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Identity-Status: Confirmed Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Is-Admin-Project: True Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Id: default Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Domain-Name: Default Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Project-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Role: member,reader Sep 01 05:57:19.088763 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Roles: member,reader Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8929d2f4d729433bb807e9f0890c9b1f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8929d2f4d729433bb807e9f0890c9b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Id: 8929d2f4d729433bb807e9f0890c9b1f Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-Tenant-Name: tempest-TestVolumeBootPattern-679369864 Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Id: default Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Domain-Name: Default Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Id: 99c0ab8ddd164b44a22370a7cc1042be Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: X-User-Name: tempest-TestVolumeBootPattern-679369864-project Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: method: > Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: exception: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.091362 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: action_args: {'id': '4d38db57-db6c-4601-9e1f-12fd7c7fcd8b'} Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: {{(pid=121033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:19.092373 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. Sep 01 05:57:19.094081 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.095716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: DEBUG nova.api.openstack.wsgi [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Returning 404 to user: Instance 4d38db57-db6c-4601-9e1f-12fd7c7fcd8b could not be found. {{(pid=121033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:19.095716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: INFO nova.api.openstack.requestlog [None req-daa5a351-bdcf-44dd-9044-5f9166051cf5 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b" status: 404 len: 111 microversion: 2.1 time: 0.029984 Sep 01 05:57:19.095716 dv-cinder-852208-15-iscsi devstack@n-api.service[121033]: [pid: 121033|app: 0|req: 617/1247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:19 2022] GET /compute/v2.1/servers/4d38db57-db6c-4601-9e1f-12fd7c7fcd8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:20.577275 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-47a94183-1801-4f29-8689-6cce70f6d3d0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] Calling method '.version_select at 0x7fbb6f13adc0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:20.664106 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-47a94183-1801-4f29-8689-6cce70f6d3d0 tempest-TestVolumeBootPattern-679369864 tempest-TestVolumeBootPattern-679369864-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1324821723" status: 202 len: 0 microversion: 2.1 time: 0.090880 Sep 01 05:57:20.664677 dv-cinder-852208-15-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 631/1248] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Sep 1 05:57:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1324821723 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)